-- Logs begin at Fri 2022-08-19 01:16:25 UTC, end at Fri 2022-08-19 02:53:33 UTC. -- Aug 19 02:25:37.669272 dv-osbrick-853457-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 02:25:37.678388 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 02:25:37 2022] *** Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: nodename: dv-osbrick-853457-2-ceph Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: machine: x86_64 Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: clock source: unix Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: pcre jit disabled Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: detected number of CPU cores: 4 Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: current working directory: / Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: detected binary path: /usr/bin/uwsgi-core Aug 19 02:25:37.680527 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: your processes number limit is 47680 Aug 19 02:25:37.681123 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: your memory page size is 4096 bytes Aug 19 02:25:37.681123 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: detected max file descriptor number: 2048 Aug 19 02:25:37.681123 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: lock engine: pthread robust mutexes Aug 19 02:25:37.681123 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: thunder lock: enabled Aug 19 02:25:37.681123 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 02:25:37.681123 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 02:25:37.724988 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: Python main interpreter initialized at 0x56310c9d39c0 Aug 19 02:25:37.724988 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: python threads support enabled Aug 19 02:25:37.724988 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: your server socket listen backlog is limited to 100 connections Aug 19 02:25:37.724988 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: your mercy for graceful operations on workers is 90 seconds Aug 19 02:25:37.725371 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 02:25:37.725434 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: *** Operational MODE: preforking *** Aug 19 02:25:37.725656 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: *** uWSGI is running in multiple interpreter mode *** Aug 19 02:25:37.725656 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: spawned uWSGI master process (pid: 88477) Aug 19 02:25:37.725912 dv-osbrick-853457-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 02:25:37.727341 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: spawned uWSGI worker 1 (pid: 88489, cores: 1) Aug 19 02:25:37.727341 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: spawned uWSGI worker 2 (pid: 88490, cores: 1) Aug 19 02:25:37.727341 dv-osbrick-853457-2-ceph devstack@keystone.service[88477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 02:25:42.308573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 02:25:42.308573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: from cryptography.utils import int_from_bytes Aug 19 02:25:42.309423 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 02:25:42.309423 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: from cryptography.utils import int_from_bytes Aug 19 02:25:42.309633 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 02:25:42.309633 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: from cryptography.utils import int_from_bytes Aug 19 02:25:42.309633 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 02:25:42.309633 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: from cryptography.utils import int_from_bytes Aug 19 02:25:42.359642 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 02:25:42.359829 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 02:25:42.359903 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 02:25:42.359995 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] command line args: [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 02:25:42.360139 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 02:25:42.360283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 02:25:42.360365 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] command line args: [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 02:25:42.360431 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ================================================================================ {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 02:25:42.360561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 02:25:42.360658 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] admin_token = **** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.360725 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ================================================================================ {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 02:25:42.360846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] config_dir = [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.360968 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] admin_token = **** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361044 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] config_source = [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] config_dir = [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] debug = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361428 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361543 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] config_source = [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361841 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] debug = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.361995 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.362055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.362123 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.362294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.362380 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.362554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.362676 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.362749 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.362957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] list_limit = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363114 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] list_limit = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363197 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] log_config_append = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] log_config_append = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363323 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363381 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] log_dir = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363509 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] log_dir = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363666 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] log_file = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] log_file = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.363917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364333 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364594 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364687 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364760 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.364960 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365019 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365149 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365320 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365766 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.365890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366235 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366345 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366517 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366669 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.366919 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.367058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.367463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.367600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.367600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] publish_errors = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.367812 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] publish_errors = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.367896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.367968 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368089 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368363 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368435 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368568 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] standard_threads = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.368968 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] standard_threads = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369523 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369604 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369676 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] use_journal = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] use_journal = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] use_json = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] use_json = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.369978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] use_stderr = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.370105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] use_stderr = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.370174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] use_syslog = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.370249 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] use_syslog = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.370324 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.370403 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:25:42.370610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.370743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.370829 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.370906 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.371116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.371257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.371350 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.371430 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.371581 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.371733 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.371845 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.371952 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.372134 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.372244 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.372346 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.372440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.372541 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.372648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.372743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.372822 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373013 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373299 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373478 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373601 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373779 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.373941 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374163 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374249 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374605 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374766 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374847 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.374918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.375138 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.375277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.375358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.375441 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.375606 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.375734 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.375823 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.375900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.376081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.376177 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.376322 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.376402 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.376571 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.376700 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.376824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.376942 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377161 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377269 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377501 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377618 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377728 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377845 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.377955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378063 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378716 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378834 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.378984 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.379152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.379262 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.379370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.379478 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.379605 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.379717 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.379826 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.379936 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.380045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.380152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.380342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.380454 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.380563 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.380671 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.380779 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.380888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381010 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381237 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381347 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381564 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381680 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381797 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.381914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382028 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382138 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382246 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382362 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382478 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.382912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383185 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383587 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383695 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383883 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.383976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384070 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384370 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384569 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384664 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384764 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.384871 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.385049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.385213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.385330 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.385464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.385581 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.385692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.385796 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.385914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386135 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386597 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386818 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.386928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.387091 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.387221 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.387335 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.387446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.387556 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.387667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.387777 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.387900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388123 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388345 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388690 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388808 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.388919 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389258 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389371 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389481 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389680 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389797 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.389908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.390128 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.390238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.390349 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.390458 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.390567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.390676 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.390788 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.390898 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.391052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.391168 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.391277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.391470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.391585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.391695 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.391805 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.391924 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392040 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392158 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392279 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392516 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392635 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392748 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.392967 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393308 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393418 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393646 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393757 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.393988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.394098 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.394216 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.394335 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.394446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.394557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.394667 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.394776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] auth.external = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.394886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] auth.external = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395064 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395181 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395292 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395431 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395553 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395666 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] auth.password = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395880 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] auth.password = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.395998 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] auth.token = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.396111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] auth.token = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.396222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.396332 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.396443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.396554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.396675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.396787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.396898 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397009 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397120 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397350 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397462 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397805 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] credential.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.397916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] credential.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398035 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398147 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398258 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398480 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398591 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398710 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398823 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.398935 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399306 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399416 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399656 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399768 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.399989 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400108 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400541 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400651 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400882 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.400993 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.401103 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.401213 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.401324 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.401442 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] federation.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.401554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] federation.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.401664 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.401773 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.401887 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402003 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402122 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402564 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402794 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.402906 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403150 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403651 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403873 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.403985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.404103 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.404217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.404328 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.404439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.404563 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.404675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.404865 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.404981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.405093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.405209 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.405321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.405432 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.405554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.405667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.405778 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.405889 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406000 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406114 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406380 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406499 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406611 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.406952 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.407105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.407223 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.407335 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.407445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.407556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.407675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.407789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.407900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408011 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408471 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408581 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408693 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408803 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.408913 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409368 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409484 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409704 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.409927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410038 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410149 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410496 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410496 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410704 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410704 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.410911 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.411082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.411199 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.411309 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.411432 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.411544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.411655 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.411774 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.411890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412003 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412334 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.412900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.413011 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.413131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.413243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.413354 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.413466 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.413649 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.413765 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.413886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414004 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414590 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414702 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414813 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.414923 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.415058 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.415183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.415309 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.415423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.415542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.415655 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.415766 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.415885 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416448 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416681 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416792 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.416904 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417015 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417126 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417580 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417692 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417803 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.417922 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.418054 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.418168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.418280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.418394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.418504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.418628 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.418742 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.418878 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419119 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419355 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419580 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419691 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419803 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.419914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420034 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420272 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420385 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420496 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420606 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420845 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.420957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421069 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421291 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421411 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421523 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421634 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421746 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421862 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.421973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.422092 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.422204 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.422316 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.422427 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.422551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.422663 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.422783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.422897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423070 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423533 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423758 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.423982 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.424093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.424213 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.424325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.424444 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.424556 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.424667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] resource.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.424778 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] resource.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.424898 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425011 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425123 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425345 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425687 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.425916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.426037 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.426149 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.426269 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.426269 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.426479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.426589 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.426700 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.426811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] role.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427010 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] role.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] role.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427459 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] role.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.427919 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428373 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428484 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428705 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428817 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.428936 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429687 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429799 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.429910 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430132 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430253 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430366 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430477 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430588 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430698 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.430930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431202 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431428 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431742 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431841 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.431941 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432037 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432131 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432351 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432680 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432800 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.432912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433473 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433807 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.433917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.434027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.434146 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.434259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.434502 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.434621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.434732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.434842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.434962 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] token.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435094 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] token.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435207 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435428 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435538 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435662 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435886 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.435997 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.436107 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.436218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.436336 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.436448 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.436560 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.436671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.436784 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.436894 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437013 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437125 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437566 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437797 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.437907 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438128 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438356 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438467 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438688 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438798 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.438908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.439087 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.connection = **** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.439212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.connection = **** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.439344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.439469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.439582 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.439694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.439804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.439914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440144 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440248 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440579 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440690 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440810 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.440922 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441142 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441251 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441362 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441481 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.441917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442146 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442481 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442702 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442826 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.442938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.443065 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.443178 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.443288 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 02:25:42.443399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:25:42.443399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 02:25:42.471707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.471855 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.471969 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.472049 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.472131 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.472333 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.480579 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.480749 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.509652 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.510069 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.510162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.510228 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.561737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.561903 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.609717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.609878 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.610000 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.610121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.675553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.675744 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.675908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.675994 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.676058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.676164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.676251 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.676404 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.676546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.676774 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.676900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.676900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.700165 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.700301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.700462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.700544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.700609 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.700682 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.700863 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.700989 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.701127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.701208 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.701272 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.701402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.701483 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.701600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.712637 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.712849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.725758 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726060 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726534 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726613 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726797 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.726876 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.727017 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.727114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.727237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.727237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:25:42.744046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.744251 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 02:25:42.744533 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.744660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.744790 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 02:25:42.744875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 02:25:42.745016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.745140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.745287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 02:25:42.745373 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.745482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.745572 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.745762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.745901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.746041 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.746255 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.755437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.755712 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.755836 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.755939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.756064 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.756239 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.756371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.756622 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.764075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.764343 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.767838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.767838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.768110 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.768219 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.768319 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.768417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.768515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.768612 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.768719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.768819 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.768918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769014 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769291 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769501 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769599 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769703 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769810 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.769909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.770008 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.770008 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.792991 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.793260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.794487 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.794775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.794900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.795063 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.799300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.799577 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.799702 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.799840 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.799919 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.800242 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.806428 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.806557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.806711 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.806837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.810748 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.810878 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.811057 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.811144 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.811322 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.811448 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.811720 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.811903 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.811997 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.812133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.812213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.812356 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.812496 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.812634 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.812716 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.812897 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.828340 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.828466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.828624 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.828708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.832456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.832582 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.835559 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.835706 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.835967 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.836096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.840213 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.840342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.843720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.843849 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.846798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.846925 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.847108 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.847295 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.847423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.847559 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.847760 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.847919 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.848027 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.848201 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.848295 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.848514 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.863959 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.864260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.864461 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.864589 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.864725 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.864814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.864993 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.865265 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.871462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.871940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.873162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.873437 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.873651 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.873857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.876088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.876373 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.876574 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.876678 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.876769 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.876945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.877073 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.877210 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.877292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.877583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.888413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.888699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.888824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.888963 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.889068 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.889218 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.889317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.889520 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.889660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.889799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.889880 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.890068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.890195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.890342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.905417 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.905835 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.908300 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.908731 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.911303 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.911897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.912741 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.913314 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.914216 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.914499 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.914779 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.914905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.915065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.915343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.921264 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.921710 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.922731 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.923190 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.925596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.925882 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.926168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.926316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.926437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.926526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.926744 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.927032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.935354 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.935647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.935875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.936003 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.936144 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.936428 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.942675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.943083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.943374 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.943518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:25:42.943637 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.943910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.944038 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.944174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.944256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.944461 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.944587 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.944737 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.944820 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.944989 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.945117 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.945273 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.945415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.945498 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.945574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.945776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.945961 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.946049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.946126 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.946301 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.946428 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.946524 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.946813 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.947079 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:25:42.979191 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56310c9d39c0 pid: 88490 (default app) Aug 19 02:25:42.980108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56310c9d39c0 pid: 88489 (default app) Aug 19 02:25:42.982672 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7804c-ee22-4255-8b09-26ed92638e8f None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:42.982960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7804c-ee22-4255-8b09-26ed92638e8f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:42.983256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7804c-ee22-4255-8b09-26ed92638e8f None None] PATH_INFO: `/v3` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:42.987428 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Fri Aug 19 02:25:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:25:50.146350 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797075-6f5b-4087-baba-2eaea96d365f None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:50.146886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797075-6f5b-4087-baba-2eaea96d365f None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:50.146886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797075-6f5b-4087-baba-2eaea96d365f None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:50.151226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:25:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:25:50.160172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:50.160880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:50.161026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:50.239602 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: INFO dbcounter [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] Registered counter for database keystone Aug 19 02:25:50.260883 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG oslo_db.sqlalchemy.engines [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 02:25:50.272490 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writer thread running {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 02:25:50.475995 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG passlib.handlers.bcrypt [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88490) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 02:25:50.476329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG passlib.handlers.bcrypt [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88490) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 02:25:50.534288 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:25:50.535942 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:25:50.674964 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:25:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 02:25:51.232753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb797075-6f5b-4087-baba-2eaea96d365f None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:51.309577 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: INFO dbcounter [None req-cb797075-6f5b-4087-baba-2eaea96d365f None None] Registered counter for database keystone Aug 19 02:25:51.336230 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG oslo_db.sqlalchemy.engines [None req-cb797075-6f5b-4087-baba-2eaea96d365f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 02:25:51.346289 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writer thread running {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 02:25:51.475424 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb797075-6f5b-4087-baba-2eaea96d365f None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:51.481707 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65aa3a-812b-49c5-8d52-cce5becf7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:51.482336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65aa3a-812b-49c5-8d52-cce5becf7e2b admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:51.482608 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65aa3a-812b-49c5-8d52-cce5becf7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:51.482934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65aa3a-812b-49c5-8d52-cce5becf7e2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:51.491881 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65aa3a-812b-49c5-8d52-cce5becf7e2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:51.544466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea65aa3a-812b-49c5-8d52-cce5becf7e2b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 02:25:51.544810 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65aa3a-812b-49c5-8d52-cce5becf7e2b admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:51.555441 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1324 bytes} [Fri Aug 19 02:25:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:25:51.565505 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:51.586499 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77437f17-7d75-4b61-afca-23c35bae9d90 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:51.593047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c4aa7-ec51-48cc-962e-f57a384cc55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:51.594174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4aa7-ec51-48cc-962e-f57a384cc55f admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:51.594454 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4aa7-ec51-48cc-962e-f57a384cc55f admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:51.594721 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4aa7-ec51-48cc-962e-f57a384cc55f admin admin] PATH_INFO: `/v3/projects/ffd15eac07ca4582ba473f869ddd41c6` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:51.596357 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c4aa7-ec51-48cc-962e-f57a384cc55f admin admin] RBAC: Authorizing `identity:get_project(project_id=ffd15eac07ca4582ba473f869ddd41c6)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:51.646977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9b8c4aa7-ec51-48cc-962e-f57a384cc55f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 02:25:51.647280 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c4aa7-ec51-48cc-962e-f57a384cc55f admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:51.651941 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 3/5] 10.222.0.69 () {56 vars in 1207 bytes} [Fri Aug 19 02:25:51 2022] GET /identity/v3/projects/ffd15eac07ca4582ba473f869ddd41c6 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:25:53.812191 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dc777-957a-4987-ab82-a2e84483ab13 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:53.813064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dc777-957a-4987-ab82-a2e84483ab13 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:53.813064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dc777-957a-4987-ab82-a2e84483ab13 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:53.819972 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 3/6] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:25:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:25:53.828784 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613765-2bdb-48fa-878a-ce34b0b19717 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:53.829216 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613765-2bdb-48fa-878a-ce34b0b19717 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:53.829351 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53613765-2bdb-48fa-878a-ce34b0b19717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:53.860080 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-53613765-2bdb-48fa-878a-ce34b0b19717 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:25:53.861659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-53613765-2bdb-48fa-878a-ce34b0b19717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:25:53.871984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:25:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 02:25:54.194746 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dc777-957a-4987-ab82-a2e84483ab13 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:54.217260 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dc777-957a-4987-ab82-a2e84483ab13 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:54.223028 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d44cec-03ab-487a-8cd9-f040ef634da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:54.223740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d44cec-03ab-487a-8cd9-f040ef634da7 admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:54.223998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d44cec-03ab-487a-8cd9-f040ef634da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:54.224264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d44cec-03ab-487a-8cd9-f040ef634da7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:54.232136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d44cec-03ab-487a-8cd9-f040ef634da7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:54.233921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d44cec-03ab-487a-8cd9-f040ef634da7 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:54.242684 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1324 bytes} [Fri Aug 19 02:25:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:25:54.248289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53613765-2bdb-48fa-878a-ce34b0b19717 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:54.258201 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53613765-2bdb-48fa-878a-ce34b0b19717 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:54.264229 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca4ba-11dc-4d95-a3ba-ebe2aa7d644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:54.264859 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca4ba-11dc-4d95-a3ba-ebe2aa7d644a admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:54.265140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca4ba-11dc-4d95-a3ba-ebe2aa7d644a admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:54.265404 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca4ba-11dc-4d95-a3ba-ebe2aa7d644a admin admin] PATH_INFO: `/v3/users/26749983e95c4ffb94568c58ecb1f0a5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:54.266922 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca4ba-11dc-4d95-a3ba-ebe2aa7d644a admin admin] RBAC: Authorizing `identity:get_user(user_id=26749983e95c4ffb94568c58ecb1f0a5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:54.268799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca4ba-11dc-4d95-a3ba-ebe2aa7d644a admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:54.270324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 5/9] 10.222.0.69 () {56 vars in 1198 bytes} [Fri Aug 19 02:25:54 2022] GET /identity/v3/users/26749983e95c4ffb94568c58ecb1f0a5 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:25:56.519982 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18cba-879a-4bad-bf2c-b3ccd6ec7776 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:56.520534 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18cba-879a-4bad-bf2c-b3ccd6ec7776 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:56.520635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce382cb-7da9-4068-a356-b20aef7a3b2e None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:56.520980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18cba-879a-4bad-bf2c-b3ccd6ec7776 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:56.521062 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce382cb-7da9-4068-a356-b20aef7a3b2e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:56.521062 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce382cb-7da9-4068-a356-b20aef7a3b2e None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:56.521902 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:25:56.522298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 6/11] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:25:56.529099 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:56.529387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:56.529573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee862-9508-4564-85d5-09d7edb19418 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:56.529674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:56.529886 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee862-9508-4564-85d5-09d7edb19418 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:56.530159 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee862-9508-4564-85d5-09d7edb19418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:56.548269 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-51cee862-9508-4564-85d5-09d7edb19418 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:25:56.549448 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-51cee862-9508-4564-85d5-09d7edb19418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:25:56.572971 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG passlib.handlers.bcrypt [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88489) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 02:25:56.573402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG passlib.handlers.bcrypt [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88489) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 02:25:56.619559 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:25:56.621232 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:25:56.745306 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:25:56.745528 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:25:57.062966 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:57.066782 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee862-9508-4564-85d5-09d7edb19418 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:57.092793 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:57.163423 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:57.166790 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003500dd-d182-4c11-b01b-001657e5ec8a None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:57.176215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee862-9508-4564-85d5-09d7edb19418 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:57.205569 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47bb92-7eb0-44a4-a5e2-253a88ff223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:57.206432 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47bb92-7eb0-44a4-a5e2-253a88ff223b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:57.206709 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47bb92-7eb0-44a4-a5e2-253a88ff223b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:57.206976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47bb92-7eb0-44a4-a5e2-253a88ff223b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:57.210547 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55a06-d82d-4a92-a355-90efb0d7b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:57.211211 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55a06-d82d-4a92-a355-90efb0d7b56b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:57.211487 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55a06-d82d-4a92-a355-90efb0d7b56b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:57.211752 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55a06-d82d-4a92-a355-90efb0d7b56b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:57.224159 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55a06-d82d-4a92-a355-90efb0d7b56b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-f3e55a06-d82d-4a92-a355-90efb0d7b56b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:25:57.232727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:25:57.233767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:25:57.234576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 8/14] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:25:57.240129 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55a06-d82d-4a92-a355-90efb0d7b56b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:57.282980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47bb92-7eb0-44a4-a5e2-253a88ff223b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:57.284530 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47bb92-7eb0-44a4-a5e2-253a88ff223b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:57.325648 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:57.344539 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55a06-d82d-4a92-a355-90efb0d7b56b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:57.378279 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:57.378880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:57.379172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:57.379472 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:57.380131 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:25:57.380414 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:57.381794 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:57.388785 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:57.398144 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 9/15] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:25:57.398326 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 7/16] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:25:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:25:57.398422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:57.399216 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47bb92-7eb0-44a4-a5e2-253a88ff223b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:57.500378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743a94a-8592-476d-88f5-952360f18a8f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:57.500625 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47bb92-7eb0-44a4-a5e2-253a88ff223b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:57.537581 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:57.538207 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:57.538507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:57.538744 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:57.551386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:57.552902 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:57.555971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:25:57.571052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:25:57.572010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:25:57.573031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:25:57.573031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:25:57.573031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:25:57.573031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 10/17] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:25:57.578790 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:57.658213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9079652-d253-4e2e-a77d-0a5a88ff5676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:57.659084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079652-d253-4e2e-a77d-0a5a88ff5676 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:57.659357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079652-d253-4e2e-a77d-0a5a88ff5676 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:57.659622 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079652-d253-4e2e-a77d-0a5a88ff5676 None admin] PATH_INFO: `/v3/users/26749983e95c4ffb94568c58ecb1f0a5` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:57.661076 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9079652-d253-4e2e-a77d-0a5a88ff5676 None admin] RBAC: Authorizing `identity:get_user(user_id=26749983e95c4ffb94568c58ecb1f0a5)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:57.662496 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9079652-d253-4e2e-a77d-0a5a88ff5676 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:57.664450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 8/18] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:25:57 2022] GET /identity/v3/users/26749983e95c4ffb94568c58ecb1f0a5 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:25:57.671235 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9079652-d253-4e2e-a77d-0a5a88ff5676 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:57.689452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cb331-815e-4e64-9d39-fb0ead5aba40 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:57.725538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:57.726147 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:57.726423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:57.726690 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:57.727555 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:25:57.727943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:57.729386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:57.746415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:57.763032 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 11/19] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:25:57.783747 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9079652-d253-4e2e-a77d-0a5a88ff5676 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:57.822351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07121a42-64b2-466c-a0d7-538d372b21cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:57.823032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07121a42-64b2-466c-a0d7-538d372b21cd None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:57.823314 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07121a42-64b2-466c-a0d7-538d372b21cd None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:57.823581 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07121a42-64b2-466c-a0d7-538d372b21cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:57.824791 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07121a42-64b2-466c-a0d7-538d372b21cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:57.826360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07121a42-64b2-466c-a0d7-538d372b21cd None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:57.833419 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 9/20] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:25:57.834375 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:57.900131 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:57.948837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8888f-3034-45cb-aea3-1bb7909f1dd5 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:57.984551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b87f7a-15ce-444c-bba4-28a1cd03c24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:57.985182 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87f7a-15ce-444c-bba4-28a1cd03c24e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:57.985454 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87f7a-15ce-444c-bba4-28a1cd03c24e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:57.985720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87f7a-15ce-444c-bba4-28a1cd03c24e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:57.986467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b87f7a-15ce-444c-bba4-28a1cd03c24e None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.domain.id=default, user.id=26749983e95c4ffb94568c58ecb1f0a5) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:25:57.986759 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b87f7a-15ce-444c-bba4-28a1cd03c24e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:57.988251 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b87f7a-15ce-444c-bba4-28a1cd03c24e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:57.995293 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 12/21] 10.222.0.69 () {56 vars in 1322 bytes} [Fri Aug 19 02:25:57 2022] GET /identity/v3/role_assignments?user.id=26749983e95c4ffb94568c58ecb1f0a5&scope.domain.id=default&role.id=22d22ddee1804d668628115534a289ab => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:00.425055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d165-38f8-4f01-aced-344522fc887d None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:00.426058 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d165-38f8-4f01-aced-344522fc887d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:00.426520 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d165-38f8-4f01-aced-344522fc887d None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:00.428047 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 10/22] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:00.433864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6bc23-a040-498c-b685-68c75f8be5b7 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:00.434812 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6bc23-a040-498c-b685-68c75f8be5b7 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:00.435294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6bc23-a040-498c-b685-68c75f8be5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:00.459170 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-40c6bc23-a040-498c-b685-68c75f8be5b7 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:00.460659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-40c6bc23-a040-498c-b685-68c75f8be5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:00.493700 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cd0b4-44b6-4c0c-878f-7e53a4c008ed None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:00.494088 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cd0b4-44b6-4c0c-878f-7e53a4c008ed None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:00.494477 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cd0b4-44b6-4c0c-878f-7e53a4c008ed None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:00.495839 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 11/23] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:00.510172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cfaf5-044e-4624-8a1d-331bfc7e91f9 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:00.510476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cfaf5-044e-4624-8a1d-331bfc7e91f9 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:00.510744 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cfaf5-044e-4624-8a1d-331bfc7e91f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:00.554209 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-7d0cfaf5-044e-4624-8a1d-331bfc7e91f9 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:00.555478 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-7d0cfaf5-044e-4624-8a1d-331bfc7e91f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:00.558842 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 13/24] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:00.656498 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 12/25] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:00.797963 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3cf2a-00c8-4921-bd0d-22a5a56bdaa1 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:00.798584 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3cf2a-00c8-4921-bd0d-22a5a56bdaa1 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:00.799113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3cf2a-00c8-4921-bd0d-22a5a56bdaa1 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:00.800898 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 14/26] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:00.812607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadf210-1d3f-4107-bd55-e8089d097973 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:00.812939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadf210-1d3f-4107-bd55-e8089d097973 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:00.813158 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadf210-1d3f-4107-bd55-e8089d097973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:00.832195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-ddadf210-1d3f-4107-bd55-e8089d097973 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:00.833753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-ddadf210-1d3f-4107-bd55-e8089d097973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:00.909658 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:00.925790 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 13/27] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:01.121248 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3cf2a-00c8-4921-bd0d-22a5a56bdaa1 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:01.127226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3da3-8d41-46b6-9dc7-5d3ec47f2ac6 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:01.127767 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3da3-8d41-46b6-9dc7-5d3ec47f2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:01.128348 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3da3-8d41-46b6-9dc7-5d3ec47f2ac6 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:01.130086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 14/28] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:01.135379 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01eb6-dde3-4b10-a3ac-ff643b9c1598 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:01.135876 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01eb6-dde3-4b10-a3ac-ff643b9c1598 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:01.136339 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01eb6-dde3-4b10-a3ac-ff643b9c1598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:01.158831 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-67a01eb6-dde3-4b10-a3ac-ff643b9c1598 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:01.160573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-67a01eb6-dde3-4b10-a3ac-ff643b9c1598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:01.192280 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:01.253175 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 15/29] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:01.253976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a01eb6-dde3-4b10-a3ac-ff643b9c1598 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:01.302979 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3cf2a-00c8-4921-bd0d-22a5a56bdaa1 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:01.378344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:01.379393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:01.379881 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:01.380344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:01.393273 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:01.395382 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:26:01.414016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:01.414958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:26:01.415785 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:26:01.415785 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:26:01.415785 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:01.417706 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 15/30] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:01.418793 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:01.485022 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a01eb6-dde3-4b10-a3ac-ff643b9c1598 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:01.537161 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:01.550151 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533cb2-5c08-41b5-bf74-7c25a5934196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:01.551019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533cb2-5c08-41b5-bf74-7c25a5934196 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:01.551306 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533cb2-5c08-41b5-bf74-7c25a5934196 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:01.551732 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533cb2-5c08-41b5-bf74-7c25a5934196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:01.566212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0533cb2-5c08-41b5-bf74-7c25a5934196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-e0533cb2-5c08-41b5-bf74-7c25a5934196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:01.576398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:01.577274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 16/31] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:01.578004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533cb2-5c08-41b5-bf74-7c25a5934196 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:01.593454 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8cf6-d686-402d-8c41-5f56650c7c73 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:01.595995 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:01.727732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d0c85-5f54-49d1-811e-273d304e4866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:01.728368 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d0c85-5f54-49d1-811e-273d304e4866 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:01.728850 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d0c85-5f54-49d1-811e-273d304e4866 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:01.728952 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d0c85-5f54-49d1-811e-273d304e4866 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:01.729567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d0c85-5f54-49d1-811e-273d304e4866 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:01.730970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d0c85-5f54-49d1-811e-273d304e4866 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:01.794237 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533cb2-5c08-41b5-bf74-7c25a5934196 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:01.838451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:01.839549 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:01.840036 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:01.840511 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:01.841475 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:01.841995 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:01.844040 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:01.869412 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 17/32] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:01.870681 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:01.910348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 16/33] 10.222.0.69 () {60 vars in 1131 bytes} [Fri Aug 19 02:26:01 2022] POST /identity/v3/roles => generated 225 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:01.910914 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d0c85-5f54-49d1-811e-273d304e4866 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:01.941823 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:02.032939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec83353-8a73-43c2-a87e-fa8c99e10d47 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:02.055584 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d0c85-5f54-49d1-811e-273d304e4866 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:02.079243 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:02.079895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.080176 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.080452 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.081470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:02.081607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:02.083213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:02.098546 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 18/34] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:02.100105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b778f-546c-4cab-8150-2184ada18054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:02.101001 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b778f-546c-4cab-8150-2184ada18054 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.101507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b778f-546c-4cab-8150-2184ada18054 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.102023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b778f-546c-4cab-8150-2184ada18054 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.103039 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b778f-546c-4cab-8150-2184ada18054 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:02.104121 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:02.105348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b778f-546c-4cab-8150-2184ada18054 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:02.125503 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 17/35] 10.222.0.69 () {60 vars in 1131 bytes} [Fri Aug 19 02:26:01 2022] POST /identity/v3/roles => generated 219 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:02.127668 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dbe93-a8ef-46f9-b5eb-50d64b052f29 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.128191 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dbe93-a8ef-46f9-b5eb-50d64b052f29 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.128684 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dbe93-a8ef-46f9-b5eb-50d64b052f29 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.130232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 18/36] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:02.131369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dbe93-a8ef-46f9-b5eb-50d64b052f29 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:02.163386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:02.256549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dbe93-a8ef-46f9-b5eb-50d64b052f29 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:02.274285 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046fc3f-64b5-4f57-9e25-1441722c2f67 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:02.285578 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:02.307767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c1c13-ddb3-4736-9842-6047f09a5119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:02.308485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c1c13-ddb3-4736-9842-6047f09a5119 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.308769 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c1c13-ddb3-4736-9842-6047f09a5119 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.309044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c1c13-ddb3-4736-9842-6047f09a5119 None admin] PATH_INFO: `/v3/users/26749983e95c4ffb94568c58ecb1f0a5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.310215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c1c13-ddb3-4736-9842-6047f09a5119 None admin] RBAC: Authorizing `identity:get_user(user_id=26749983e95c4ffb94568c58ecb1f0a5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:02.311730 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c1c13-ddb3-4736-9842-6047f09a5119 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:02.313533 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 19/37] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:02 2022] GET /identity/v3/users/26749983e95c4ffb94568c58ecb1f0a5 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:02.316216 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d384bd9-4e63-473e-96c9-dacd4780f8fc None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.319558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d384bd9-4e63-473e-96c9-dacd4780f8fc None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.320414 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d384bd9-4e63-473e-96c9-dacd4780f8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.323968 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a16949-052e-4837-b082-4b460f11b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:02.324670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a16949-052e-4837-b082-4b460f11b48a None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.324922 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a16949-052e-4837-b082-4b460f11b48a None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.325575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a16949-052e-4837-b082-4b460f11b48a None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.326757 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a16949-052e-4837-b082-4b460f11b48a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:02.327487 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a16949-052e-4837-b082-4b460f11b48a None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:02.343160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-8d384bd9-4e63-473e-96c9-dacd4780f8fc None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:02.344735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-8d384bd9-4e63-473e-96c9-dacd4780f8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:02.423151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 20/38] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:02.424438 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd12a-b875-4a71-be65-9688ec74cdc2 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.424719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd12a-b875-4a71-be65-9688ec74cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.424991 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd12a-b875-4a71-be65-9688ec74cdc2 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.426400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 21/39] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:02.426899 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bd12a-b875-4a71-be65-9688ec74cdc2 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:02.453946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:02.499217 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 19/40] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:26:02 2022] POST /identity/v3/projects => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:02.502858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f13b9-15c4-4c21-a001-e67e089abc64 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.503707 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f13b9-15c4-4c21-a001-e67e089abc64 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.504178 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f13b9-15c4-4c21-a001-e67e089abc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.529305 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-3c6f13b9-15c4-4c21-a001-e67e089abc64 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:02.531643 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-3c6f13b9-15c4-4c21-a001-e67e089abc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:02.550604 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bd12a-b875-4a71-be65-9688ec74cdc2 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:02.596468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658ea05-3395-4eb3-9625-103bae771a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:02.597298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ea05-3395-4eb3-9625-103bae771a37 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.597615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ea05-3395-4eb3-9625-103bae771a37 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.597889 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ea05-3395-4eb3-9625-103bae771a37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.599774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658ea05-3395-4eb3-9625-103bae771a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:02.601987 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658ea05-3395-4eb3-9625-103bae771a37 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:02.604070 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 22/41] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:02.610204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658ea05-3395-4eb3-9625-103bae771a37 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:02.630590 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 20/42] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:02.709736 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:02.725331 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658ea05-3395-4eb3-9625-103bae771a37 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:02.760576 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f13b9-15c4-4c21-a001-e67e089abc64 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:02.763656 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353216e3-5c71-4910-ac85-91c74ce2e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:02.764620 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353216e3-5c71-4910-ac85-91c74ce2e6d4 None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.764942 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353216e3-5c71-4910-ac85-91c74ce2e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.765126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353216e3-5c71-4910-ac85-91c74ce2e6d4 None admin] PATH_INFO: `/v3/domains/default/users/26749983e95c4ffb94568c58ecb1f0a5/roles/22d22ddee1804d668628115534a289ab` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.768431 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353216e3-5c71-4910-ac85-91c74ce2e6d4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=26749983e95c4ffb94568c58ecb1f0a5, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:02.769919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353216e3-5c71-4910-ac85-91c74ce2e6d4 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:02.790916 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 23/43] 10.222.0.69 () {58 vars in 1361 bytes} [Fri Aug 19 02:26:02 2022] PUT /identity/v3/domains/default/users/26749983e95c4ffb94568c58ecb1f0a5/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:02.876306 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:02.889443 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f13b9-15c4-4c21-a001-e67e089abc64 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:02.930106 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216dc38-8053-4202-8c0b-67b525b2f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:02.930757 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216dc38-8053-4202-8c0b-67b525b2f55d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:02.931052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216dc38-8053-4202-8c0b-67b525b2f55d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:02.931335 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216dc38-8053-4202-8c0b-67b525b2f55d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:02.932544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216dc38-8053-4202-8c0b-67b525b2f55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:02.934223 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216dc38-8053-4202-8c0b-67b525b2f55d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:02.936264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 21/44] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:02.941928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353216e3-5c71-4910-ac85-91c74ce2e6d4 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:02.968365 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216dc38-8053-4202-8c0b-67b525b2f55d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:03.055393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353216e3-5c71-4910-ac85-91c74ce2e6d4 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:03.078538 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216dc38-8053-4202-8c0b-67b525b2f55d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:03.091860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382ed9c-f25a-436e-bc69-2fc44c3a2985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:03.092859 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382ed9c-f25a-436e-bc69-2fc44c3a2985 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:03.093127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382ed9c-f25a-436e-bc69-2fc44c3a2985 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:03.093398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382ed9c-f25a-436e-bc69-2fc44c3a2985 None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:03.094053 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382ed9c-f25a-436e-bc69-2fc44c3a2985 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:03.095557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382ed9c-f25a-436e-bc69-2fc44c3a2985 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:03.113351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b640-2ce0-4ca9-a840-6b46819b32a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:03.114089 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b640-2ce0-4ca9-a840-6b46819b32a0 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:03.114285 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b640-2ce0-4ca9-a840-6b46819b32a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:03.114501 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b640-2ce0-4ca9-a840-6b46819b32a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:03.115371 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2b640-2ce0-4ca9-a840-6b46819b32a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:03.116736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2b640-2ce0-4ca9-a840-6b46819b32a0 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:03.119917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:03.135496 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 24/45] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:26:02 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:03.136178 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 22/46] 10.222.0.69 () {60 vars in 1131 bytes} [Fri Aug 19 02:26:02 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:04.991224 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31ced2-667a-4983-af42-1e38899bb23f None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:04.991742 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31ced2-667a-4983-af42-1e38899bb23f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:04.991849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31ced2-667a-4983-af42-1e38899bb23f None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:04.993117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 25/47] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:04.998754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0a1b-3f16-4f0d-b95d-78fdde1213ff None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:04.999165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0a1b-3f16-4f0d-b95d-78fdde1213ff None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:04.999330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0a1b-3f16-4f0d-b95d-78fdde1213ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:05.018684 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b4af0a1b-3f16-4f0d-b95d-78fdde1213ff None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:05.020057 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b4af0a1b-3f16-4f0d-b95d-78fdde1213ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:05.035690 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:05.094646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 23/48] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:05.383679 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac23e-5d0d-46b8-9a10-98cc30c01a30 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:05.384020 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac23e-5d0d-46b8-9a10-98cc30c01a30 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:05.384303 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac23e-5d0d-46b8-9a10-98cc30c01a30 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:05.385619 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 26/49] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:05.391038 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7d94-9c50-4fbc-946d-d5fec80c8267 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:05.391332 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7d94-9c50-4fbc-946d-d5fec80c8267 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:05.391619 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7d94-9c50-4fbc-946d-d5fec80c8267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:05.410049 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-397c7d94-9c50-4fbc-946d-d5fec80c8267 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:05.411275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-397c7d94-9c50-4fbc-946d-d5fec80c8267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:05.424532 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ac23e-5d0d-46b8-9a10-98cc30c01a30 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:05.480576 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 24/50] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:05.528831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ac23e-5d0d-46b8-9a10-98cc30c01a30 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:05.563515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f4fb9-88a9-4963-8cd9-275986fb4e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:05.564145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f4fb9-88a9-4963-8cd9-275986fb4e47 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:05.564423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f4fb9-88a9-4963-8cd9-275986fb4e47 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:05.564688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f4fb9-88a9-4963-8cd9-275986fb4e47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:05.574784 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f4fb9-88a9-4963-8cd9-275986fb4e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-3b3f4fb9-88a9-4963-8cd9-275986fb4e47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:05.579482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:05.580315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:05.581056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 27/51] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:05.586772 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7d94-9c50-4fbc-946d-d5fec80c8267 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:05.671757 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:05.694266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7d94-9c50-4fbc-946d-d5fec80c8267 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:05.728561 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:05.729186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:05.729463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:05.729735 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:05.730386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:05.730693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:05.732142 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:05.740503 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 25/52] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:05.746514 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f4fb9-88a9-4963-8cd9-275986fb4e47 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:05.799132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:05.808763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:05.852526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f4fb9-88a9-4963-8cd9-275986fb4e47 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:05.885497 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c859c-47ff-4e29-88c5-804c79c00a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:05.886129 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c859c-47ff-4e29-88c5-804c79c00a0b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:05.886405 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c859c-47ff-4e29-88c5-804c79c00a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:05.886672 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c859c-47ff-4e29-88c5-804c79c00a0b None admin] PATH_INFO: `/v3/users/26749983e95c4ffb94568c58ecb1f0a5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:05.887923 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c859c-47ff-4e29-88c5-804c79c00a0b None admin] RBAC: Authorizing `identity:get_user(user_id=26749983e95c4ffb94568c58ecb1f0a5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:05.889387 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c859c-47ff-4e29-88c5-804c79c00a0b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:05.890960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 28/53] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:05 2022] GET /identity/v3/users/26749983e95c4ffb94568c58ecb1f0a5 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:05.896467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c859c-47ff-4e29-88c5-804c79c00a0b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:05.901488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb133f8-a66a-4de8-9cb6-14e20828d4c6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:05.936841 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331244d-955b-4948-b7b3-d247ee994c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:05.937412 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331244d-955b-4948-b7b3-d247ee994c19 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:05.937693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331244d-955b-4948-b7b3-d247ee994c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:05.937965 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331244d-955b-4948-b7b3-d247ee994c19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:05.939172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331244d-955b-4948-b7b3-d247ee994c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:05.940620 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331244d-955b-4948-b7b3-d247ee994c19 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:05.942225 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 26/54] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:05.947811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331244d-955b-4948-b7b3-d247ee994c19 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:05.958565 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:05.994545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c859c-47ff-4e29-88c5-804c79c00a0b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:06.021187 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:06.030363 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298df965-424f-4fc9-88af-3bcdd9118ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:06.031022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298df965-424f-4fc9-88af-3bcdd9118ce3 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:06.031304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298df965-424f-4fc9-88af-3bcdd9118ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:06.031594 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298df965-424f-4fc9-88af-3bcdd9118ce3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:06.033012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298df965-424f-4fc9-88af-3bcdd9118ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:06.034183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298df965-424f-4fc9-88af-3bcdd9118ce3 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:06.036171 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 29/55] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:06.041907 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298df965-424f-4fc9-88af-3bcdd9118ce3 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:06.051373 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331244d-955b-4948-b7b3-d247ee994c19 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:06.085832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71074577-3a07-45c8-86db-f1e741217836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:06.086453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71074577-3a07-45c8-86db-f1e741217836 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:06.086734 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71074577-3a07-45c8-86db-f1e741217836 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:06.087020 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71074577-3a07-45c8-86db-f1e741217836 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:06.087699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71074577-3a07-45c8-86db-f1e741217836 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:06.089170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71074577-3a07-45c8-86db-f1e741217836 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:06.118189 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 27/56] 10.222.0.69 () {60 vars in 1140 bytes} [Fri Aug 19 02:26:05 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:06.160217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298df965-424f-4fc9-88af-3bcdd9118ce3 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:06.200378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf97e90-6729-403f-9e53-8658d8b2aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:06.200912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97e90-6729-403f-9e53-8658d8b2aec2 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:06.201177 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97e90-6729-403f-9e53-8658d8b2aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:06.201447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97e90-6729-403f-9e53-8658d8b2aec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:06.202188 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97e90-6729-403f-9e53-8658d8b2aec2 None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.domain.id=default, user.id=26749983e95c4ffb94568c58ecb1f0a5) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:06.202491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97e90-6729-403f-9e53-8658d8b2aec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:06.204012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97e90-6729-403f-9e53-8658d8b2aec2 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:06.210692 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 30/57] 10.222.0.69 () {56 vars in 1322 bytes} [Fri Aug 19 02:26:06 2022] GET /identity/v3/role_assignments?user.id=26749983e95c4ffb94568c58ecb1f0a5&scope.domain.id=default&role.id=22d22ddee1804d668628115534a289ab => generated 530 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:08.279620 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5170-0bfb-4558-8d3e-b83976e8252e None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:08.280475 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5170-0bfb-4558-8d3e-b83976e8252e None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:08.280475 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5170-0bfb-4558-8d3e-b83976e8252e None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:08.282565 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 28/58] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:08.290811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462159-7e33-490c-b12a-3dfb50e98c15 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:08.291305 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462159-7e33-490c-b12a-3dfb50e98c15 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:08.291391 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462159-7e33-490c-b12a-3dfb50e98c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:08.309786 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-0d462159-7e33-490c-b12a-3dfb50e98c15 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:08.310967 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-0d462159-7e33-490c-b12a-3dfb50e98c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:08.368835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:08.380574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 31/59] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:08.704495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d5170-0bfb-4558-8d3e-b83976e8252e None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:08.778162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:08.822975 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d5170-0bfb-4558-8d3e-b83976e8252e None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:08.865284 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b935a-a558-4f92-8b8d-1ca9deb26b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:08.865925 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b935a-a558-4f92-8b8d-1ca9deb26b67 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:08.866205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b935a-a558-4f92-8b8d-1ca9deb26b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:08.866446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b935a-a558-4f92-8b8d-1ca9deb26b67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:08.867703 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b935a-a558-4f92-8b8d-1ca9deb26b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:08.869219 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b935a-a558-4f92-8b8d-1ca9deb26b67 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:08.870790 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 29/60] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:08.876989 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d462159-7e33-490c-b12a-3dfb50e98c15 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:08.987978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d462159-7e33-490c-b12a-3dfb50e98c15 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:09.029027 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934ef00-e26c-448b-8cb1-d754137f9919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:09.029639 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934ef00-e26c-448b-8cb1-d754137f9919 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:09.029917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934ef00-e26c-448b-8cb1-d754137f9919 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:09.030191 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934ef00-e26c-448b-8cb1-d754137f9919 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:09.030826 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934ef00-e26c-448b-8cb1-d754137f9919 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:09.032340 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934ef00-e26c-448b-8cb1-d754137f9919 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:09.061397 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 32/61] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:26:08 2022] POST /identity/v3/users => generated 275 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:12.627156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f57c2-b902-4db3-a01c-ef398a66f9be None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.628182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f57c2-b902-4db3-a01c-ef398a66f9be None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.628688 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f57c2-b902-4db3-a01c-ef398a66f9be None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.630224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 30/62] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:12.635850 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35312a4-e2ea-4298-a108-eff0e13506c0 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.636279 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35312a4-e2ea-4298-a108-eff0e13506c0 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.636401 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35312a4-e2ea-4298-a108-eff0e13506c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.655016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e786-9165-46bd-a5df-a90064dec232 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.655656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e786-9165-46bd-a5df-a90064dec232 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.656128 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e786-9165-46bd-a5df-a90064dec232 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.657671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:12.662515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-f35312a4-e2ea-4298-a108-eff0e13506c0 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:12.663226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8934-4e19-422f-af96-38952d7a7309 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.663736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8934-4e19-422f-af96-38952d7a7309 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.663837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-f35312a4-e2ea-4298-a108-eff0e13506c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:12.664292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8934-4e19-422f-af96-38952d7a7309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.689376 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-a5cf8934-4e19-422f-af96-38952d7a7309 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:12.690601 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-a5cf8934-4e19-422f-af96-38952d7a7309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:12.758371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:12.783333 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 32/64] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:12.791019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1c222-dbf3-49b7-8034-811e00514e89 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.791019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1c222-dbf3-49b7-8034-811e00514e89 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.791019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1c222-dbf3-49b7-8034-811e00514e89 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.791019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 33/65] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:12.796807 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3112b5-6a4f-4a86-bcdd-54e4b4e7572d None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.797085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3112b5-6a4f-4a86-bcdd-54e4b4e7572d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.797357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3112b5-6a4f-4a86-bcdd-54e4b4e7572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.825799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 33/66] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:12.840105 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-fa3112b5-6a4f-4a86-bcdd-54e4b4e7572d None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:12.841443 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-fa3112b5-6a4f-4a86-bcdd-54e4b4e7572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:12.886236 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef8c0-50c7-4263-af0a-e7aefb21d51c None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.886511 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef8c0-50c7-4263-af0a-e7aefb21d51c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.886694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef8c0-50c7-4263-af0a-e7aefb21d51c None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.888520 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 34/67] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:12.893162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d500-fd2b-453c-bf7c-f7fc254d3860 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.893437 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d500-fd2b-453c-bf7c-f7fc254d3860 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.893705 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d500-fd2b-453c-bf7c-f7fc254d3860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.922455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-14e8d500-fd2b-453c-bf7c-f7fc254d3860 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:12.923658 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-14e8d500-fd2b-453c-bf7c-f7fc254d3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:12.939361 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:12.963621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 34/68] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:12.972719 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0827-f049-4cd5-8775-4a375a3e9a35 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.973190 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0827-f049-4cd5-8775-4a375a3e9a35 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.973604 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0827-f049-4cd5-8775-4a375a3e9a35 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.975206 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 35/69] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:12.980393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed033841-db0c-4393-b466-d9ca1fcbe808 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:12.980837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed033841-db0c-4393-b466-d9ca1fcbe808 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:12.981250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed033841-db0c-4393-b466-d9ca1fcbe808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:12.999701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-ed033841-db0c-4393-b466-d9ca1fcbe808 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:13.001222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-ed033841-db0c-4393-b466-d9ca1fcbe808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:13.066774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 35/70] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:13.136583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 36/71] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:13.152860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8d500-fd2b-453c-bf7c-f7fc254d3860 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.260840 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8d500-fd2b-453c-bf7c-f7fc254d3860 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.265497 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed033841-db0c-4393-b466-d9ca1fcbe808 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.270495 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:13.298541 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13c48-e71f-4418-9b0a-4cd0ef2477b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.299455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13c48-e71f-4418-9b0a-4cd0ef2477b6 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.299873 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13c48-e71f-4418-9b0a-4cd0ef2477b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.300309 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13c48-e71f-4418-9b0a-4cd0ef2477b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.311089 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c13c48-e71f-4418-9b0a-4cd0ef2477b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-10c13c48-e71f-4418-9b0a-4cd0ef2477b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:13.316198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:13.317090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:13.317843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:13.320302 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 36/72] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:13.326255 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13c48-e71f-4418-9b0a-4cd0ef2477b6 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.427140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed033841-db0c-4393-b466-d9ca1fcbe808 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.445468 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:13.446865 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13c48-e71f-4418-9b0a-4cd0ef2477b6 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.466510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d05c52-b30b-47cf-9984-2f4d18dc5bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.467224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d05c52-b30b-47cf-9984-2f4d18dc5bd7 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.467829 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d05c52-b30b-47cf-9984-2f4d18dc5bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.468106 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d05c52-b30b-47cf-9984-2f4d18dc5bd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.478772 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d05c52-b30b-47cf-9984-2f4d18dc5bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-77d05c52-b30b-47cf-9984-2f4d18dc5bd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:13.483646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:13.484460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:13.485224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 37/73] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:13.485837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d05c52-b30b-47cf-9984-2f4d18dc5bd7 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.491610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.492431 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.492883 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.493153 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.493827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:13.494128 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:13.495589 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:13.509413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 37/74] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:13.509413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.538050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:13.596256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d05c52-b30b-47cf-9984-2f4d18dc5bd7 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.616656 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912ae35-9d4a-443a-b8e1-ebbadb5c855b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.628296 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7126a0-a20f-4426-93d9-b44b372361d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.628927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7126a0-a20f-4426-93d9-b44b372361d8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.629202 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7126a0-a20f-4426-93d9-b44b372361d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.629470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7126a0-a20f-4426-93d9-b44b372361d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.639678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7126a0-a20f-4426-93d9-b44b372361d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-cb7126a0-a20f-4426-93d9-b44b372361d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:13.644334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:13.645199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:13.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 38/75] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:13.646576 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7126a0-a20f-4426-93d9-b44b372361d8 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.655375 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28dee8-89c8-4917-b4c8-b5705c2466e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.655878 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28dee8-89c8-4917-b4c8-b5705c2466e0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.655977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28dee8-89c8-4917-b4c8-b5705c2466e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.656231 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28dee8-89c8-4917-b4c8-b5705c2466e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.657470 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28dee8-89c8-4917-b4c8-b5705c2466e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:13.658940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28dee8-89c8-4917-b4c8-b5705c2466e0 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:13.660540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 38/76] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:13.661291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28dee8-89c8-4917-b4c8-b5705c2466e0 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.687420 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:13.748090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7126a0-a20f-4426-93d9-b44b372361d8 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.751984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:13.758816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28dee8-89c8-4917-b4c8-b5705c2466e0 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.783775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.784422 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.784699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.785266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.785617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:13.785917 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:13.787360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:13.794180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0733fc-26ac-448b-b8ab-77cac3510ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.794810 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0733fc-26ac-448b-b8ab-77cac3510ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.795113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0733fc-26ac-448b-b8ab-77cac3510ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.795384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0733fc-26ac-448b-b8ab-77cac3510ae8 None admin] PATH_INFO: `/v3/users/26749983e95c4ffb94568c58ecb1f0a5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.795532 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 39/77] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:13.796623 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0733fc-26ac-448b-b8ab-77cac3510ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=26749983e95c4ffb94568c58ecb1f0a5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:13.798076 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0733fc-26ac-448b-b8ab-77cac3510ae8 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:13.799669 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 39/78] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/users/26749983e95c4ffb94568c58ecb1f0a5 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:13.800042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.800799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0733fc-26ac-448b-b8ab-77cac3510ae8 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.899741 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:13.899929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0733fc-26ac-448b-b8ab-77cac3510ae8 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.903650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d70147-e8dc-4d01-aeca-42006b5a2742 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:13.935103 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.935718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.935994 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.936264 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.936931 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] RBAC: Adding query filter params (name=member) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:13.937235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:13.937486 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bdf1b-e445-4400-8aeb-d31c8b376c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:13.938075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bdf1b-e445-4400-8aeb-d31c8b376c3a None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:13.938356 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bdf1b-e445-4400-8aeb-d31c8b376c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:13.938615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:13.938706 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bdf1b-e445-4400-8aeb-d31c8b376c3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:13.946677 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 40/79] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:13.947472 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.949064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bdf1b-e445-4400-8aeb-d31c8b376c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-1e9bdf1b-e445-4400-8aeb-d31c8b376c3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:13.954268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:13.955321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 40/80] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:13.959895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bdf1b-e445-4400-8aeb-d31c8b376c3a None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:13.979047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.048809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b554e-8269-4a16-933f-0437cc6f9974 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:14.058596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bdf1b-e445-4400-8aeb-d31c8b376c3a None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:14.081962 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416c91-d995-4e40-9a58-7755d5909cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:14.082579 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416c91-d995-4e40-9a58-7755d5909cb7 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:14.082858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416c91-d995-4e40-9a58-7755d5909cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:14.083191 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416c91-d995-4e40-9a58-7755d5909cb7 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:14.083809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9416c91-d995-4e40-9a58-7755d5909cb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:14.085256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9416c91-d995-4e40-9a58-7755d5909cb7 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:14.091601 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090868db-7e11-4bf6-a7ba-1e32e3d0e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:14.092303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090868db-7e11-4bf6-a7ba-1e32e3d0e5be None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:14.092923 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090868db-7e11-4bf6-a7ba-1e32e3d0e5be None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:14.093188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090868db-7e11-4bf6-a7ba-1e32e3d0e5be None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:14.108776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090868db-7e11-4bf6-a7ba-1e32e3d0e5be None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:14.109317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 41/81] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:26:13 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:14.110155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416c91-d995-4e40-9a58-7755d5909cb7 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:14.110248 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090868db-7e11-4bf6-a7ba-1e32e3d0e5be None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:14.116722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 41/82] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:13 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:14.117717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090868db-7e11-4bf6-a7ba-1e32e3d0e5be None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:14.140296 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.205773 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.226766 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416c91-d995-4e40-9a58-7755d5909cb7 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:14.236769 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090868db-7e11-4bf6-a7ba-1e32e3d0e5be None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:14.262928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b2919-ac52-44a4-abf2-3c335be8a3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:14.263562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2919-ac52-44a4-abf2-3c335be8a3f1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:14.263840 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2919-ac52-44a4-abf2-3c335be8a3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:14.264109 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2919-ac52-44a4-abf2-3c335be8a3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:14.278946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d3294-cf22-40e7-a1da-4d25c3e38b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:14.279639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3294-cf22-40e7-a1da-4d25c3e38b41 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:14.279916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3294-cf22-40e7-a1da-4d25c3e38b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:14.280187 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3294-cf22-40e7-a1da-4d25c3e38b41 None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:14.281359 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3294-cf22-40e7-a1da-4d25c3e38b41 None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:14.282838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3294-cf22-40e7-a1da-4d25c3e38b41 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:14.288981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 42/83] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:14 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:14.288981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d3294-cf22-40e7-a1da-4d25c3e38b41 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:14.354415 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b2919-ac52-44a4-abf2-3c335be8a3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:14.356766 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b2919-ac52-44a4-abf2-3c335be8a3f1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:14.395385 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.416504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d3294-cf22-40e7-a1da-4d25c3e38b41 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:14.464719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.465016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:14.466267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:14.466722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:14.467209 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:14.468545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:14.469254 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:14.470821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:14.482715 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 43/84] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:14.483801 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:14.490026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 42/85] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:14.491103 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b2919-ac52-44a4-abf2-3c335be8a3f1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:14.605725 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b2919-ac52-44a4-abf2-3c335be8a3f1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:14.613764 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209dd9f-6b79-4a33-b329-3d8412706f46 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:14.650704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f02c-d0e3-4668-9911-d6c07cf746b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:14.651835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f02c-d0e3-4668-9911-d6c07cf746b8 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:14.652287 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64a1d-34f8-448a-abb8-c6399bbeabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:14.652771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f02c-d0e3-4668-9911-d6c07cf746b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:14.653090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64a1d-34f8-448a-abb8-c6399bbeabca None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:14.653325 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f02c-d0e3-4668-9911-d6c07cf746b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:14.653684 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64a1d-34f8-448a-abb8-c6399bbeabca None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:14.654092 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64a1d-34f8-448a-abb8-c6399bbeabca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:14.677345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.718592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.739090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64a1d-34f8-448a-abb8-c6399bbeabca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:14.741600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64a1d-34f8-448a-abb8-c6399bbeabca None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:14.743286 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f02c-d0e3-4668-9911-d6c07cf746b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:14.745469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f02c-d0e3-4668-9911-d6c07cf746b8 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:14.864141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 44/86] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:14.864141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64a1d-34f8-448a-abb8-c6399bbeabca None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:14.872050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 43/87] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:14.873121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f02c-d0e3-4668-9911-d6c07cf746b8 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:14.922138 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.972426 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:14.992661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f02c-d0e3-4668-9911-d6c07cf746b8 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:14.998579 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64a1d-34f8-448a-abb8-c6399bbeabca None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.028968 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8fb7-f704-4a35-9099-bff0c454dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.029603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8fb7-f704-4a35-9099-bff0c454dc87 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.029974 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8fb7-f704-4a35-9099-bff0c454dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.030254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8fb7-f704-4a35-9099-bff0c454dc87 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.031515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8fb7-f704-4a35-9099-bff0c454dc87 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.033055 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8fb7-f704-4a35-9099-bff0c454dc87 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.035052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 44/88] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:14 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:15.035907 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8fb7-f704-4a35-9099-bff0c454dc87 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:15.036583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42792efb-13ce-4dda-9353-c34e7280814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.037455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42792efb-13ce-4dda-9353-c34e7280814b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.037922 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42792efb-13ce-4dda-9353-c34e7280814b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.038532 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42792efb-13ce-4dda-9353-c34e7280814b None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.040032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42792efb-13ce-4dda-9353-c34e7280814b None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.041707 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42792efb-13ce-4dda-9353-c34e7280814b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.043770 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 45/89] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:14 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:15.044808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42792efb-13ce-4dda-9353-c34e7280814b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:15.145212 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8fb7-f704-4a35-9099-bff0c454dc87 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.154122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42792efb-13ce-4dda-9353-c34e7280814b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.171813 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:15.185031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849b66c-4e11-484b-b6c2-88388e5540f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.185990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b66c-4e11-484b-b6c2-88388e5540f1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.186269 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b66c-4e11-484b-b6c2-88388e5540f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.186536 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b66c-4e11-484b-b6c2-88388e5540f1 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.187906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849b66c-4e11-484b-b6c2-88388e5540f1 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.190038 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849b66c-4e11-484b-b6c2-88388e5540f1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.196348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 45/90] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:15.196348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849b66c-4e11-484b-b6c2-88388e5540f1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:15.199669 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b77cc6-1235-4945-a3b3-11bc2c5c9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.200360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b77cc6-1235-4945-a3b3-11bc2c5c9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.200614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b77cc6-1235-4945-a3b3-11bc2c5c9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.200880 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b77cc6-1235-4945-a3b3-11bc2c5c9bc3 None admin] PATH_INFO: `/v3/projects/2694d649515f485ca5a00097cfdaeeb0` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.215027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b77cc6-1235-4945-a3b3-11bc2c5c9bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=2694d649515f485ca5a00097cfdaeeb0)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.215027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b77cc6-1235-4945-a3b3-11bc2c5c9bc3 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.215027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 46/91] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/projects/2694d649515f485ca5a00097cfdaeeb0 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:15.215027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b77cc6-1235-4945-a3b3-11bc2c5c9bc3 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:15.229036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:15.330036 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b77cc6-1235-4945-a3b3-11bc2c5c9bc3 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.337717 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849b66c-4e11-484b-b6c2-88388e5540f1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.372741 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d2ac4-4267-47a5-9079-dde110ba1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.373388 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d2ac4-4267-47a5-9079-dde110ba1bde None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.373922 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d2ac4-4267-47a5-9079-dde110ba1bde None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.374196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d2ac4-4267-47a5-9079-dde110ba1bde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.383080 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.383792 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.384141 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.384504 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.385316 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.project.id=66d19a41099445d1876e9c42ba23261f, user.id=26749983e95c4ffb94568c58ecb1f0a5) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:15.385689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.387309 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.399332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 46/92] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/role_assignments?user.id=26749983e95c4ffb94568c58ecb1f0a5&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=22d22ddee1804d668628115534a289ab => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:15.400456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:15.445607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:15.467336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d2ac4-4267-47a5-9079-dde110ba1bde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.469464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d2ac4-4267-47a5-9079-dde110ba1bde None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.590553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 47/93] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:15.591323 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d2ac4-4267-47a5-9079-dde110ba1bde None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:15.600614 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:15.653326 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae8b8-a816-4138-84cb-36af5ba5e250 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.700002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.700975 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.701255 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.701528 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.702252 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] RBAC: Adding query filter params (role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=66d19a41099445d1876e9c42ba23261f, user.id=21f5b87c9ea84f509bfa337f93338038) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:15.702566 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.705125 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.705304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:15.713047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 47/94] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/role_assignments?user.id=21f5b87c9ea84f509bfa337f93338038&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:15.714051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:15.725465 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d2ac4-4267-47a5-9079-dde110ba1bde None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.781719 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.782605 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.783088 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.783503 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.785043 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] RBAC: Adding query filter params (role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=2694d649515f485ca5a00097cfdaeeb0, user.id=21f5b87c9ea84f509bfa337f93338038) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:15.785526 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.787204 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.797417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 48/95] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/role_assignments?user.id=21f5b87c9ea84f509bfa337f93338038&scope.project.id=2694d649515f485ca5a00097cfdaeeb0&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:15.908026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f504fd-17e5-4f6f-a3a9-6153cd76548b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.967347 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7bdd3-7105-4755-8255-6252526ed69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.968372 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7bdd3-7105-4755-8255-6252526ed69b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.968647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7bdd3-7105-4755-8255-6252526ed69b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.968974 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7bdd3-7105-4755-8255-6252526ed69b None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.976050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7bdd3-7105-4755-8255-6252526ed69b None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.977656 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7bdd3-7105-4755-8255-6252526ed69b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.979664 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 48/96] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:15.986557 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:16.115942 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cea675-041c-452c-b629-1e891b19e21b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:16.156692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530b3e3-c8c8-486e-a300-d09bf6494f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:16.157327 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b3e3-c8c8-486e-a300-d09bf6494f15 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:16.157613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b3e3-c8c8-486e-a300-d09bf6494f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:16.157886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b3e3-c8c8-486e-a300-d09bf6494f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:16.158684 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530b3e3-c8c8-486e-a300-d09bf6494f15 None admin] RBAC: Adding query filter params (role.id=e7e1d965bd9b4d52a96f59ba3965c5ed, scope.project.id=66d19a41099445d1876e9c42ba23261f, user.id=21f5b87c9ea84f509bfa337f93338038) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:16.158940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530b3e3-c8c8-486e-a300-d09bf6494f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:16.160470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530b3e3-c8c8-486e-a300-d09bf6494f15 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:16.170737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 49/97] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/role_assignments?user.id=21f5b87c9ea84f509bfa337f93338038&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=e7e1d965bd9b4d52a96f59ba3965c5ed => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:16.758947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641817d-b2a4-4727-ac95-fe9c62c00689 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:16.759252 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641817d-b2a4-4727-ac95-fe9c62c00689 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:16.759525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641817d-b2a4-4727-ac95-fe9c62c00689 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:16.762896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 49/98] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:16.775866 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd0b0-710b-4163-90a5-f34cdbdf2a84 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:16.776353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd0b0-710b-4163-90a5-f34cdbdf2a84 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:16.776464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd0b0-710b-4163-90a5-f34cdbdf2a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:16.803337 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-092fd0b0-710b-4163-90a5-f34cdbdf2a84 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:16.804541 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-092fd0b0-710b-4163-90a5-f34cdbdf2a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:16.814896 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:16.896434 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 50/99] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:16.934725 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351852-b057-478e-b2ec-46427d880478 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:16.935312 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351852-b057-478e-b2ec-46427d880478 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:16.935312 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351852-b057-478e-b2ec-46427d880478 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:16.936754 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 50/100] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:16.941776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02b279-2aa0-4422-ad7d-f76e46cb6517 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:16.942066 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02b279-2aa0-4422-ad7d-f76e46cb6517 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:16.942342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02b279-2aa0-4422-ad7d-f76e46cb6517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:16.968571 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-0e02b279-2aa0-4422-ad7d-f76e46cb6517 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:16.969768 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-0e02b279-2aa0-4422-ad7d-f76e46cb6517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:17.038281 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 51/101] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:17.411226 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2351852-b057-478e-b2ec-46427d880478 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:17.427968 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:17.524306 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2351852-b057-478e-b2ec-46427d880478 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:17.531761 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02b279-2aa0-4422-ad7d-f76e46cb6517 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:17.578623 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3669170-04c8-4d5e-bc9d-f525d024e422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:17.579302 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3669170-04c8-4d5e-bc9d-f525d024e422 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:17.579585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3669170-04c8-4d5e-bc9d-f525d024e422 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:17.579920 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3669170-04c8-4d5e-bc9d-f525d024e422 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:17.582424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3669170-04c8-4d5e-bc9d-f525d024e422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:17.583928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3669170-04c8-4d5e-bc9d-f525d024e422 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:17.585811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 51/102] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:17.591265 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3669170-04c8-4d5e-bc9d-f525d024e422 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:17.671452 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:17.726039 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02b279-2aa0-4422-ad7d-f76e46cb6517 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:17.751381 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:17.797713 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3669170-04c8-4d5e-bc9d-f525d024e422 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:17.821790 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d304af-6be6-47b8-aac0-84edcd54582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:17.822518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d304af-6be6-47b8-aac0-84edcd54582a None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:17.822738 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d304af-6be6-47b8-aac0-84edcd54582a None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:17.823034 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d304af-6be6-47b8-aac0-84edcd54582a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:17.854615 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d304af-6be6-47b8-aac0-84edcd54582a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-e0d304af-6be6-47b8-aac0-84edcd54582a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:17.860013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:17.860840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:17.861600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 52/103] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:17.867708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0255b5f-7ed2-4fb3-8d0b-af707edf9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:17.868595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0255b5f-7ed2-4fb3-8d0b-af707edf9422 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:17.869087 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0255b5f-7ed2-4fb3-8d0b-af707edf9422 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:17.869587 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0255b5f-7ed2-4fb3-8d0b-af707edf9422 None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:17.870437 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0255b5f-7ed2-4fb3-8d0b-af707edf9422 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:17.872150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0255b5f-7ed2-4fb3-8d0b-af707edf9422 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:17.879995 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d304af-6be6-47b8-aac0-84edcd54582a None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:17.918831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 52/104] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:26:17 2022] POST /identity/v3/projects => generated 302 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:18.039805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d304af-6be6-47b8-aac0-84edcd54582a None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:18.099175 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:18.111897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:18.112556 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:18.112837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:18.113109 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:18.113799 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] RBAC: Adding query filter params (name=reader) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:18.114104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:18.115545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:18.126423 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 53/105] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:18.136157 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0255b5f-7ed2-4fb3-8d0b-af707edf9422 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:18.273091 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0255b5f-7ed2-4fb3-8d0b-af707edf9422 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:18.311151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f75ad-cee4-4fb0-9312-d7dcedb069c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:18.311734 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f75ad-cee4-4fb0-9312-d7dcedb069c3 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:18.312012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f75ad-cee4-4fb0-9312-d7dcedb069c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:18.312286 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f75ad-cee4-4fb0-9312-d7dcedb069c3 None admin] PATH_INFO: `/v3/users/1a5055e630574e86bd27e6b38a66cb17` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:18.314427 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:18.329271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f75ad-cee4-4fb0-9312-d7dcedb069c3 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5055e630574e86bd27e6b38a66cb17)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:18.330891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f75ad-cee4-4fb0-9312-d7dcedb069c3 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:18.333138 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 53/106] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:18 2022] GET /identity/v3/users/1a5055e630574e86bd27e6b38a66cb17 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:18.338969 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:18.478811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fb7eb-4bd7-4e02-a951-f30f385c9dad None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:18.524129 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b78747-eb94-4644-9155-fde60e8dd5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:18.524761 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78747-eb94-4644-9155-fde60e8dd5ae None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:18.525045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78747-eb94-4644-9155-fde60e8dd5ae None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:18.525316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78747-eb94-4644-9155-fde60e8dd5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:18.605484 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:18.614815 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b78747-eb94-4644-9155-fde60e8dd5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:18.616351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b78747-eb94-4644-9155-fde60e8dd5ae None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:18.745400 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 54/107] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:18.751460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f75ad-cee4-4fb0-9312-d7dcedb069c3 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:18.871907 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f75ad-cee4-4fb0-9312-d7dcedb069c3 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:18.914669 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a660a7-778e-439f-a087-34c7a2cc7670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:18.915351 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a660a7-778e-439f-a087-34c7a2cc7670 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:18.915633 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a660a7-778e-439f-a087-34c7a2cc7670 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:18.915903 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a660a7-778e-439f-a087-34c7a2cc7670 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:18.917054 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a660a7-778e-439f-a087-34c7a2cc7670 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:18.918515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a660a7-778e-439f-a087-34c7a2cc7670 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:18.920396 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 54/108] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:18 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:18.926535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b78747-eb94-4644-9155-fde60e8dd5ae None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:19.009512 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51594-d67c-4585-b0e1-d8924129b82e None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.009844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51594-d67c-4585-b0e1-d8924129b82e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.010065 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51594-d67c-4585-b0e1-d8924129b82e None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.011556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 55/109] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:19.017831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744b32-09b2-4d45-8232-10dc14f13803 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.018118 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744b32-09b2-4d45-8232-10dc14f13803 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.018393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e744b32-09b2-4d45-8232-10dc14f13803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.052205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-2e744b32-09b2-4d45-8232-10dc14f13803 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:19.053463 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-2e744b32-09b2-4d45-8232-10dc14f13803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:19.054016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:19.070242 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b78747-eb94-4644-9155-fde60e8dd5ae None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:19.161565 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd846a5f-f054-4589-bd51-defada9e9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:19.162176 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846a5f-f054-4589-bd51-defada9e9192 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.162455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846a5f-f054-4589-bd51-defada9e9192 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.162768 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846a5f-f054-4589-bd51-defada9e9192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.163538 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd846a5f-f054-4589-bd51-defada9e9192 None admin] RBAC: Adding query filter params (role.id=ad59177e2ed34618b4eddfa1ba66c8c5, scope.project.id=66d19a41099445d1876e9c42ba23261f, user.id=1a5055e630574e86bd27e6b38a66cb17) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:19.163850 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd846a5f-f054-4589-bd51-defada9e9192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:19.164728 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:19.167226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd846a5f-f054-4589-bd51-defada9e9192 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:19.179836 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 55/110] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:18 2022] GET /identity/v3/role_assignments?user.id=1a5055e630574e86bd27e6b38a66cb17&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=ad59177e2ed34618b4eddfa1ba66c8c5 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:19.188270 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 56/111] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:19.299593 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733320-328d-4080-8ea8-1fc2f6e188ee None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.299926 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733320-328d-4080-8ea8-1fc2f6e188ee None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.300152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733320-328d-4080-8ea8-1fc2f6e188ee None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.301748 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 56/112] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:19.307561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bb88-0f56-428c-a5ab-e613d65cfbdc None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.308172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bb88-0f56-428c-a5ab-e613d65cfbdc None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.308631 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bb88-0f56-428c-a5ab-e613d65cfbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.335329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-a836bb88-0f56-428c-a5ab-e613d65cfbdc None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:19.336893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-a836bb88-0f56-428c-a5ab-e613d65cfbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:19.358675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12877f42-31dc-4816-99e4-c4adc45f7b06 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.359026 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12877f42-31dc-4816-99e4-c4adc45f7b06 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.359262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12877f42-31dc-4816-99e4-c4adc45f7b06 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.360594 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 57/113] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:19.366445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7bf4-7ffb-481f-a5c1-0c045af1cfb0 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.366752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7bf4-7ffb-481f-a5c1-0c045af1cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.367047 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7bf4-7ffb-481f-a5c1-0c045af1cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.388301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-560f7bf4-7ffb-481f-a5c1-0c045af1cfb0 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:19.389555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-560f7bf4-7ffb-481f-a5c1-0c045af1cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:19.434242 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 57/114] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:19.458667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47e1f-2808-4cda-acbb-35c9506378ef None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.459300 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47e1f-2808-4cda-acbb-35c9506378ef None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.459742 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47e1f-2808-4cda-acbb-35c9506378ef None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.461508 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 58/115] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:19.472675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d383-3aa5-4d49-ac24-5a13c8a69fac None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.472879 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 58/116] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:19.473422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d383-3aa5-4d49-ac24-5a13c8a69fac None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.473937 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d383-3aa5-4d49-ac24-5a13c8a69fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.503792 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-ab71d383-3aa5-4d49-ac24-5a13c8a69fac None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:19.505308 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-ab71d383-3aa5-4d49-ac24-5a13c8a69fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:19.595134 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 59/117] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:19.646139 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f7bf4-7ffb-481f-a5c1-0c045af1cfb0 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:19.752190 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:19.775744 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f7bf4-7ffb-481f-a5c1-0c045af1cfb0 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:19.812230 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9990a4-349a-480a-80ff-5fbbd3ba116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:19.813227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9990a4-349a-480a-80ff-5fbbd3ba116b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.813718 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9990a4-349a-480a-80ff-5fbbd3ba116b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.814171 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9990a4-349a-480a-80ff-5fbbd3ba116b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.825645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9990a4-349a-480a-80ff-5fbbd3ba116b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-9b9990a4-349a-480a-80ff-5fbbd3ba116b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:19.830729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:19.831602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:19.832367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:19.834946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 59/118] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:19.841223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71d383-3aa5-4d49-ac24-5a13c8a69fac None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:19.894701 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:19.945465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71d383-3aa5-4d49-ac24-5a13c8a69fac None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:19.985381 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:19.986390 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.986851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.987324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.988337 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:19.988850 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:19.990530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:19.992276 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9990a4-349a-480a-80ff-5fbbd3ba116b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.021784 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 60/119] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:20.037113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.183905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9990a4-349a-480a-80ff-5fbbd3ba116b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.202595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0c56-17e2-4e5e-91b2-5ef56289ee32 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.217995 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:20.224366 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffc3d5-8f1f-4111-aa93-870350755abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.224986 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffc3d5-8f1f-4111-aa93-870350755abb None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.225331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffc3d5-8f1f-4111-aa93-870350755abb None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.225609 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffc3d5-8f1f-4111-aa93-870350755abb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.237058 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffc3d5-8f1f-4111-aa93-870350755abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-eaffc3d5-8f1f-4111-aa93-870350755abb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:20.241913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:20.242776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 60/120] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:20.243950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffc3d5-8f1f-4111-aa93-870350755abb None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.245682 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96dcdd-4e84-45ec-b198-b5e28e03d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.246549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96dcdd-4e84-45ec-b198-b5e28e03d56f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.247056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96dcdd-4e84-45ec-b198-b5e28e03d56f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.247558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96dcdd-4e84-45ec-b198-b5e28e03d56f None admin] PATH_INFO: `/v3/users/26749983e95c4ffb94568c58ecb1f0a5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.249183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96dcdd-4e84-45ec-b198-b5e28e03d56f None admin] RBAC: Authorizing `identity:get_user(user_id=26749983e95c4ffb94568c58ecb1f0a5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:20.250826 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96dcdd-4e84-45ec-b198-b5e28e03d56f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:20.252948 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 61/121] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/users/26749983e95c4ffb94568c58ecb1f0a5 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:20.258408 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96dcdd-4e84-45ec-b198-b5e28e03d56f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.260167 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:20.362183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffc3d5-8f1f-4111-aa93-870350755abb None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.384927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96dcdd-4e84-45ec-b198-b5e28e03d56f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.399102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2afc2-2a0e-41b1-9bf2-40822cdf3fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.400017 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2afc2-2a0e-41b1-9bf2-40822cdf3fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.400436 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2afc2-2a0e-41b1-9bf2-40822cdf3fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.400846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2afc2-2a0e-41b1-9bf2-40822cdf3fd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.411940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2afc2-2a0e-41b1-9bf2-40822cdf3fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-8da2afc2-2a0e-41b1-9bf2-40822cdf3fd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:20.417061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:20.417903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:20.418660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:20.421019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 61/122] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:20.421995 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2afc2-2a0e-41b1-9bf2-40822cdf3fd6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.426299 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff181fd-1a1f-4d42-86e1-55c1830c8fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.427310 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff181fd-1a1f-4d42-86e1-55c1830c8fc2 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.427825 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff181fd-1a1f-4d42-86e1-55c1830c8fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.428102 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff181fd-1a1f-4d42-86e1-55c1830c8fc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.445219 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff181fd-1a1f-4d42-86e1-55c1830c8fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-dff181fd-1a1f-4d42-86e1-55c1830c8fc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:20.452486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:20.453385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:20.454160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:20.457437 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 62/123] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:20.458368 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff181fd-1a1f-4d42-86e1-55c1830c8fc2 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.504216 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:20.514549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:20.556413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2afc2-2a0e-41b1-9bf2-40822cdf3fd6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.589431 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff181fd-1a1f-4d42-86e1-55c1830c8fc2 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.593459 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.594257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.594625 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.595020 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.595811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:20.596215 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:20.597856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:20.606678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 62/124] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:20.611964 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.633284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d58f-f4f8-422f-9b24-8284d9d40c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.634170 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d58f-f4f8-422f-9b24-8284d9d40c73 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.634582 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d58f-f4f8-422f-9b24-8284d9d40c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.634985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d58f-f4f8-422f-9b24-8284d9d40c73 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.636288 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45d58f-f4f8-422f-9b24-8284d9d40c73 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:20.638749 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45d58f-f4f8-422f-9b24-8284d9d40c73 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:20.641290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 63/125] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:20.642429 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d58f-f4f8-422f-9b24-8284d9d40c73 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.723408 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69592b-edb3-4def-9683-8549f995868b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.759064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:20.772781 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.773411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.773792 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.774327 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.775151 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:20.776583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:20.778045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:20.789855 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d58f-f4f8-422f-9b24-8284d9d40c73 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.790406 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 63/126] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:20.791275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.802426 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:20.838689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.840398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.840804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.841229 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.842040 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:20.843197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:20.844802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:20.857759 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 64/127] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:20.863628 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:20.917301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d35638-4312-440e-a39c-6ddaf84adf68 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:20.957531 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaadbb-779c-4092-be28-24bc0981b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:20.958268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaadbb-779c-4092-be28-24bc0981b8ac None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:20.958503 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaadbb-779c-4092-be28-24bc0981b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:20.958780 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaadbb-779c-4092-be28-24bc0981b8ac None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:20.959986 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaadbb-779c-4092-be28-24bc0981b8ac None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:20.961436 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaadbb-779c-4092-be28-24bc0981b8ac None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:20.963023 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 64/128] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:20.968286 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaadbb-779c-4092-be28-24bc0981b8ac None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:21.010113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a14b2-b537-43ef-ae55-f6b53530f9f1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.035788 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:21.046526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd899-4d93-43b9-89d8-6b88159a186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.047589 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd899-4d93-43b9-89d8-6b88159a186c None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.047696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd899-4d93-43b9-89d8-6b88159a186c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.047888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd899-4d93-43b9-89d8-6b88159a186c None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f/users/26749983e95c4ffb94568c58ecb1f0a5/roles/22d22ddee1804d668628115534a289ab` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.049765 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd899-4d93-43b9-89d8-6b88159a186c None admin] RBAC: Authorizing `identity:create_grant(project_id=66d19a41099445d1876e9c42ba23261f, user_id=26749983e95c4ffb94568c58ecb1f0a5, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.051347 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd899-4d93-43b9-89d8-6b88159a186c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:21.066124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 65/129] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:20 2022] PUT /identity/v3/projects/66d19a41099445d1876e9c42ba23261f/users/26749983e95c4ffb94568c58ecb1f0a5/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:21.067122 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd899-4d93-43b9-89d8-6b88159a186c None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:21.086789 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaadbb-779c-4092-be28-24bc0981b8ac None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.106337 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:21.150659 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7fc92-b7df-4f8e-a7e6-de9f83b35b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.151736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7fc92-b7df-4f8e-a7e6-de9f83b35b4b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.152237 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7fc92-b7df-4f8e-a7e6-de9f83b35b4b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.152707 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7fc92-b7df-4f8e-a7e6-de9f83b35b4b None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.154131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7fc92-b7df-4f8e-a7e6-de9f83b35b4b None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.155851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7fc92-b7df-4f8e-a7e6-de9f83b35b4b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:21.157645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 65/130] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:20 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:21.158597 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7fc92-b7df-4f8e-a7e6-de9f83b35b4b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:21.198287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd899-4d93-43b9-89d8-6b88159a186c None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.237921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe502ca8-12eb-4fc4-8896-7148f874ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.238599 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe502ca8-12eb-4fc4-8896-7148f874ce16 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.239047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe502ca8-12eb-4fc4-8896-7148f874ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.239459 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe502ca8-12eb-4fc4-8896-7148f874ce16 None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.245947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe502ca8-12eb-4fc4-8896-7148f874ce16 None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.245947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe502ca8-12eb-4fc4-8896-7148f874ce16 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:21.245947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 66/131] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:21 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:21.245947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe502ca8-12eb-4fc4-8896-7148f874ce16 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:21.343438 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7fc92-b7df-4f8e-a7e6-de9f83b35b4b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.370093 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:21.375641 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe502ca8-12eb-4fc4-8896-7148f874ce16 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.388598 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:21.402432 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742917f5-12f4-4d66-a738-5fac1c0bf3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.404331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742917f5-12f4-4d66-a738-5fac1c0bf3ca None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.404623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742917f5-12f4-4d66-a738-5fac1c0bf3ca None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.404903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742917f5-12f4-4d66-a738-5fac1c0bf3ca None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.406303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742917f5-12f4-4d66-a738-5fac1c0bf3ca None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.408613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742917f5-12f4-4d66-a738-5fac1c0bf3ca None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:21.410335 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 66/132] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:21 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:21.411083 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742917f5-12f4-4d66-a738-5fac1c0bf3ca None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:21.424426 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92f3e8-7c0a-4cd0-8292-4c189475797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.425796 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92f3e8-7c0a-4cd0-8292-4c189475797a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.426282 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92f3e8-7c0a-4cd0-8292-4c189475797a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.427191 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92f3e8-7c0a-4cd0-8292-4c189475797a None admin] PATH_INFO: `/v3/projects/2694d649515f485ca5a00097cfdaeeb0` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.428878 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92f3e8-7c0a-4cd0-8292-4c189475797a None admin] RBAC: Authorizing `identity:get_project(project_id=2694d649515f485ca5a00097cfdaeeb0)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.431108 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92f3e8-7c0a-4cd0-8292-4c189475797a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:21.433401 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 67/133] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:21 2022] GET /identity/v3/projects/2694d649515f485ca5a00097cfdaeeb0 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:21.435148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ddab-f12e-44a8-acf3-e73bace213db None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.435609 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ddab-f12e-44a8-acf3-e73bace213db None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.436051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ddab-f12e-44a8-acf3-e73bace213db None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.437409 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 68/134] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:21.438703 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ddab-f12e-44a8-acf3-e73bace213db None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:21.530362 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742917f5-12f4-4d66-a738-5fac1c0bf3ca None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.566589 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cedaf6-b628-4585-b6d7-1c0bd7473ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.567359 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cedaf6-b628-4585-b6d7-1c0bd7473ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.567758 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cedaf6-b628-4585-b6d7-1c0bd7473ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.568107 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cedaf6-b628-4585-b6d7-1c0bd7473ee9 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.569342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cedaf6-b628-4585-b6d7-1c0bd7473ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.570876 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cedaf6-b628-4585-b6d7-1c0bd7473ee9 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:21.572666 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 67/135] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:21 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:21.575808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c28092-a323-403a-a9a4-f3005eb4f288 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.576270 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c28092-a323-403a-a9a4-f3005eb4f288 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.576813 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c28092-a323-403a-a9a4-f3005eb4f288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.579844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ddab-f12e-44a8-acf3-e73bace213db None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.600533 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-29c28092-a323-403a-a9a4-f3005eb4f288 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:21.602069 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-29c28092-a323-403a-a9a4-f3005eb4f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:21.618243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cd52a-7f13-47de-9707-f21ea22ea129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.619101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd52a-7f13-47de-9707-f21ea22ea129 None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.619488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd52a-7f13-47de-9707-f21ea22ea129 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.619851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd52a-7f13-47de-9707-f21ea22ea129 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f/users/21f5b87c9ea84f509bfa337f93338038/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.621788 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cd52a-7f13-47de-9707-f21ea22ea129 None admin] RBAC: Authorizing `identity:create_grant(project_id=66d19a41099445d1876e9c42ba23261f, user_id=21f5b87c9ea84f509bfa337f93338038, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.623400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cd52a-7f13-47de-9707-f21ea22ea129 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:21.643205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 69/136] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:21 2022] PUT /identity/v3/projects/66d19a41099445d1876e9c42ba23261f/users/21f5b87c9ea84f509bfa337f93338038/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:21.644350 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cd52a-7f13-47de-9707-f21ea22ea129 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:21.674227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:21.687450 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:21.705944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 68/137] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:21.707184 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c28092-a323-403a-a9a4-f3005eb4f288 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:21.780053 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cd52a-7f13-47de-9707-f21ea22ea129 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.822745 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35e53c-00a3-405a-979b-c5338d03399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.823433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35e53c-00a3-405a-979b-c5338d03399b None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.823708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35e53c-00a3-405a-979b-c5338d03399b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.823977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35e53c-00a3-405a-979b-c5338d03399b None admin] PATH_INFO: `/v3/projects/2694d649515f485ca5a00097cfdaeeb0/users/21f5b87c9ea84f509bfa337f93338038/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.827634 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35e53c-00a3-405a-979b-c5338d03399b None admin] RBAC: Authorizing `identity:create_grant(project_id=2694d649515f485ca5a00097cfdaeeb0, user_id=21f5b87c9ea84f509bfa337f93338038, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.829338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35e53c-00a3-405a-979b-c5338d03399b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:21.848040 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 70/138] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:21 2022] PUT /identity/v3/projects/2694d649515f485ca5a00097cfdaeeb0/users/21f5b87c9ea84f509bfa337f93338038/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:21.935735 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c28092-a323-403a-a9a4-f3005eb4f288 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:21.982343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38d56b-b1ae-40dd-aaba-46e52e5bd1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:21.983156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38d56b-b1ae-40dd-aaba-46e52e5bd1c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:21.983439 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38d56b-b1ae-40dd-aaba-46e52e5bd1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:21.983710 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38d56b-b1ae-40dd-aaba-46e52e5bd1c4 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f/users/21f5b87c9ea84f509bfa337f93338038/roles/e7e1d965bd9b4d52a96f59ba3965c5ed` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:21.985884 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38d56b-b1ae-40dd-aaba-46e52e5bd1c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=66d19a41099445d1876e9c42ba23261f, user_id=21f5b87c9ea84f509bfa337f93338038, role_id=e7e1d965bd9b4d52a96f59ba3965c5ed)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:21.987370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38d56b-b1ae-40dd-aaba-46e52e5bd1c4 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:22.012188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 69/139] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:21 2022] PUT /identity/v3/projects/66d19a41099445d1876e9c42ba23261f/users/21f5b87c9ea84f509bfa337f93338038/roles/e7e1d965bd9b4d52a96f59ba3965c5ed => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:22.114329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732bb0c-3712-4b18-86e4-87bdbfb3e077 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:22.114672 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732bb0c-3712-4b18-86e4-87bdbfb3e077 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:22.114936 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732bb0c-3712-4b18-86e4-87bdbfb3e077 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:22.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 71/140] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:22.134099 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a1a56-3618-464c-a2d0-43170285b082 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:22.134677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a1a56-3618-464c-a2d0-43170285b082 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:22.134677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a1a56-3618-464c-a2d0-43170285b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:22.164275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-7e3a1a56-3618-464c-a2d0-43170285b082 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:22.165525 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-7e3a1a56-3618-464c-a2d0-43170285b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:22.247739 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:22.252079 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732bb0c-3712-4b18-86e4-87bdbfb3e077 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:22.280914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 70/141] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:22.382100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:22.400976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732bb0c-3712-4b18-86e4-87bdbfb3e077 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:22.436441 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c22f53-28b0-4598-83cb-da953a8e24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:22.437077 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c22f53-28b0-4598-83cb-da953a8e24c0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:22.437356 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c22f53-28b0-4598-83cb-da953a8e24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:22.437642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c22f53-28b0-4598-83cb-da953a8e24c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:22.439103 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c22f53-28b0-4598-83cb-da953a8e24c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:22.440612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c22f53-28b0-4598-83cb-da953a8e24c0 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:22.442196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 72/142] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:22.447907 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a1a56-3618-464c-a2d0-43170285b082 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:22.553943 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a1a56-3618-464c-a2d0-43170285b082 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:22.598111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93d751-5517-4327-98c3-5983265022a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:22.598793 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d751-5517-4327-98c3-5983265022a6 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:22.599105 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d751-5517-4327-98c3-5983265022a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:22.599385 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d751-5517-4327-98c3-5983265022a6 None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:22.600138 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93d751-5517-4327-98c3-5983265022a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:22.601622 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93d751-5517-4327-98c3-5983265022a6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:22.646687 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 71/143] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:26:22 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:22.906328 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c22f53-28b0-4598-83cb-da953a8e24c0 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:23.020379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c22f53-28b0-4598-83cb-da953a8e24c0 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:23.058560 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038d92f-0869-4b51-9f85-9ceeba1d2a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:23.059227 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d92f-0869-4b51-9f85-9ceeba1d2a4a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:23.059499 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d92f-0869-4b51-9f85-9ceeba1d2a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:23.059799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d92f-0869-4b51-9f85-9ceeba1d2a4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:23.076567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038d92f-0869-4b51-9f85-9ceeba1d2a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-7038d92f-0869-4b51-9f85-9ceeba1d2a4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:23.081400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:23.082235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:23.084169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 73/144] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:23.091991 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93d751-5517-4327-98c3-5983265022a6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:23.147741 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:23.218886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93d751-5517-4327-98c3-5983265022a6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:23.257701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:23.258387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:23.258674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:23.258945 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:23.259692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:23.259998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:23.261402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:23.270313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 72/145] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:23.276024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038d92f-0869-4b51-9f85-9ceeba1d2a4a None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:23.301786 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:23.406081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038d92f-0869-4b51-9f85-9ceeba1d2a4a None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:23.445587 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13113d-3a32-4860-8a07-05ddeb02fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:23.446235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13113d-3a32-4860-8a07-05ddeb02fda0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:23.446663 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13113d-3a32-4860-8a07-05ddeb02fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:23.446773 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13113d-3a32-4860-8a07-05ddeb02fda0 None admin] PATH_INFO: `/v3/users/1a5055e630574e86bd27e6b38a66cb17` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:23.447924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13113d-3a32-4860-8a07-05ddeb02fda0 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5055e630574e86bd27e6b38a66cb17)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:23.449382 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13113d-3a32-4860-8a07-05ddeb02fda0 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:23.451269 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 74/146] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:23 2022] GET /identity/v3/users/1a5055e630574e86bd27e6b38a66cb17 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:23.457364 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:23.601593 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ec8e9-7525-49db-8998-51748dfa2587 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:23.603179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:23.647084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d8cb6-905f-47ec-a1fd-200066225436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:23.647742 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8cb6-905f-47ec-a1fd-200066225436 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:23.648021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8cb6-905f-47ec-a1fd-200066225436 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:23.648294 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8cb6-905f-47ec-a1fd-200066225436 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:23.649436 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d8cb6-905f-47ec-a1fd-200066225436 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:23.650953 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d8cb6-905f-47ec-a1fd-200066225436 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:23.652940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 73/147] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:23 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:23.659026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13113d-3a32-4860-8a07-05ddeb02fda0 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:23.771448 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:23.782058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13113d-3a32-4860-8a07-05ddeb02fda0 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:23.828305 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e29d-a6b4-460e-8aea-423f13cac51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:23.829415 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e29d-a6b4-460e-8aea-423f13cac51e None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:23.829892 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e29d-a6b4-460e-8aea-423f13cac51e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:23.830372 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e29d-a6b4-460e-8aea-423f13cac51e None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f/users/1a5055e630574e86bd27e6b38a66cb17/roles/ad59177e2ed34618b4eddfa1ba66c8c5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:23.832903 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80e29d-a6b4-460e-8aea-423f13cac51e None admin] RBAC: Authorizing `identity:create_grant(project_id=66d19a41099445d1876e9c42ba23261f, user_id=1a5055e630574e86bd27e6b38a66cb17, role_id=ad59177e2ed34618b4eddfa1ba66c8c5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:23.834691 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80e29d-a6b4-460e-8aea-423f13cac51e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:23.852804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 75/148] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:23 2022] PUT /identity/v3/projects/66d19a41099445d1876e9c42ba23261f/users/1a5055e630574e86bd27e6b38a66cb17/roles/ad59177e2ed34618b4eddfa1ba66c8c5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:24.341210 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944f7c-7a29-451f-b633-0d4f07e40515 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:24.342200 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944f7c-7a29-451f-b633-0d4f07e40515 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:24.343059 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944f7c-7a29-451f-b633-0d4f07e40515 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:24.344677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 74/149] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:24.351500 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b516-242f-4826-a8b1-35fbb448d54b None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:24.352392 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b516-242f-4826-a8b1-35fbb448d54b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:24.352876 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5b516-242f-4826-a8b1-35fbb448d54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:24.376403 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-3ae5b516-242f-4826-a8b1-35fbb448d54b None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:24.378042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-3ae5b516-242f-4826-a8b1-35fbb448d54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:24.468227 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 76/150] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:24.833311 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f944f7c-7a29-451f-b633-0d4f07e40515 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:24.964675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f944f7c-7a29-451f-b633-0d4f07e40515 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:24.970757 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b5051-6e20-4e8d-a0b1-9a081e1ebb39 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:24.971376 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b5051-6e20-4e8d-a0b1-9a081e1ebb39 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:24.971845 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b5051-6e20-4e8d-a0b1-9a081e1ebb39 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:24.973598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 77/151] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:24.983653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb469-8e79-4c08-a908-785a0b53cb70 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:24.983653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb469-8e79-4c08-a908-785a0b53cb70 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:24.984044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb469-8e79-4c08-a908-785a0b53cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:25.016002 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076b4d-58a2-4426-ba05-c2e3cc749cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:25.017214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076b4d-58a2-4426-ba05-c2e3cc749cfa None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:25.017740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076b4d-58a2-4426-ba05-c2e3cc749cfa None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:25.018212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076b4d-58a2-4426-ba05-c2e3cc749cfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:25.034746 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e076b4d-58a2-4426-ba05-c2e3cc749cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:25.035118 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-e91eb469-8e79-4c08-a908-785a0b53cb70 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:25.036316 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-e91eb469-8e79-4c08-a908-785a0b53cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-8e076b4d-58a2-4426-ba05-c2e3cc749cfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:25.040999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:25.041930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:25.042701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:25.046535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 75/152] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:25.053073 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076b4d-58a2-4426-ba05-c2e3cc749cfa None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:25.095415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:25.163887 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 78/153] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:25.196621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076b4d-58a2-4426-ba05-c2e3cc749cfa None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:25.246855 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb63bef-cc10-4094-99d9-11b82bba18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:25.247701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63bef-cc10-4094-99d9-11b82bba18e6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:25.247978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63bef-cc10-4094-99d9-11b82bba18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:25.248250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63bef-cc10-4094-99d9-11b82bba18e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:25.248929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb63bef-cc10-4094-99d9-11b82bba18e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:25.249235 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb63bef-cc10-4094-99d9-11b82bba18e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:25.250641 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb63bef-cc10-4094-99d9-11b82bba18e6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:25.264699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 76/154] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:25.266240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb469-8e79-4c08-a908-785a0b53cb70 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:25.269090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:25.357346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac535d-5c8e-48f3-9a37-75bc493cade6 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:25.357888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac535d-5c8e-48f3-9a37-75bc493cade6 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:25.357888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac535d-5c8e-48f3-9a37-75bc493cade6 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:25.360547 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 77/155] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:25.366320 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97edfd-f3ea-4aaa-83fc-d7de84b64f03 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:25.366628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97edfd-f3ea-4aaa-83fc-d7de84b64f03 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:25.366939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97edfd-f3ea-4aaa-83fc-d7de84b64f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:25.396899 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-fc97edfd-f3ea-4aaa-83fc-d7de84b64f03 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:25.398197 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-fc97edfd-f3ea-4aaa-83fc-d7de84b64f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:25.402395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb469-8e79-4c08-a908-785a0b53cb70 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:25.448779 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327c66-dced-4015-8231-433f093f6e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:25.449423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327c66-dced-4015-8231-433f093f6e2b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:25.449697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327c66-dced-4015-8231-433f093f6e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:25.449964 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327c66-dced-4015-8231-433f093f6e2b None admin] PATH_INFO: `/v3/users/26749983e95c4ffb94568c58ecb1f0a5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:25.455701 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80327c66-dced-4015-8231-433f093f6e2b None admin] RBAC: Authorizing `identity:get_user(user_id=26749983e95c4ffb94568c58ecb1f0a5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:25.457195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80327c66-dced-4015-8231-433f093f6e2b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:25.458853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 79/156] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:25 2022] GET /identity/v3/users/26749983e95c4ffb94568c58ecb1f0a5 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:25.488097 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327c66-dced-4015-8231-433f093f6e2b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:25.507553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 78/157] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:25.596100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:25.634445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327c66-dced-4015-8231-433f093f6e2b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:25.678672 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7df20-4351-47e8-897f-37aadcd5d70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:25.679320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7df20-4351-47e8-897f-37aadcd5d70f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:25.679592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7df20-4351-47e8-897f-37aadcd5d70f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:25.679859 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7df20-4351-47e8-897f-37aadcd5d70f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:25.752528 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7df20-4351-47e8-897f-37aadcd5d70f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:25.754017 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7df20-4351-47e8-897f-37aadcd5d70f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:25.841814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:25.883198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 80/158] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:25.889249 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97edfd-f3ea-4aaa-83fc-d7de84b64f03 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:25.971020 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:25.988110 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7df20-4351-47e8-897f-37aadcd5d70f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:26.050324 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97edfd-f3ea-4aaa-83fc-d7de84b64f03 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:26.120676 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94ebe-c5be-49b8-8355-47a844eb3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:26.121339 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94ebe-c5be-49b8-8355-47a844eb3e06 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:26.121715 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94ebe-c5be-49b8-8355-47a844eb3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:26.121987 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94ebe-c5be-49b8-8355-47a844eb3e06 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:26.123381 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c94ebe-c5be-49b8-8355-47a844eb3e06 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:26.124851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c94ebe-c5be-49b8-8355-47a844eb3e06 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:26.131107 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 79/159] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:25 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:26.132712 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94ebe-c5be-49b8-8355-47a844eb3e06 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:26.153044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7df20-4351-47e8-897f-37aadcd5d70f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:26.207737 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eabed6-c46b-4cfc-b8ca-00c474cd8810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:26.208391 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eabed6-c46b-4cfc-b8ca-00c474cd8810 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:26.208665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eabed6-c46b-4cfc-b8ca-00c474cd8810 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:26.208934 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eabed6-c46b-4cfc-b8ca-00c474cd8810 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:26.223901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eabed6-c46b-4cfc-b8ca-00c474cd8810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-88eabed6-c46b-4cfc-b8ca-00c474cd8810 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:26.232783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:26.233642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:26.234488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 81/160] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:26.239594 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eabed6-c46b-4cfc-b8ca-00c474cd8810 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:26.278876 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:26.309747 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:26.329950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94ebe-c5be-49b8-8355-47a844eb3e06 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:26.369192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eabed6-c46b-4cfc-b8ca-00c474cd8810 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:26.395471 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:26.396149 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:26.396369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:26.396638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:26.397374 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.project.id=66d19a41099445d1876e9c42ba23261f, user.id=26749983e95c4ffb94568c58ecb1f0a5) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:26.397776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:26.399365 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:26.412192 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 80/161] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:26 2022] GET /identity/v3/role_assignments?user.id=26749983e95c4ffb94568c58ecb1f0a5&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=22d22ddee1804d668628115534a289ab => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:26.413054 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:26.422704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:26.423364 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:26.423618 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:26.423880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:26.424561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:26.424857 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:26.426271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:26.443923 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 82/162] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:26.449783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:26.597438 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:26.612393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4454-7983-448c-b87b-17a953d96ac6 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:26.645263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046ee07-06ce-4ad9-82c5-05c45ca9543f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:26.672385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4a716-6431-4940-81a5-c338c0ddbbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:26.672978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4a716-6431-4940-81a5-c338c0ddbbfe None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:26.673239 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4a716-6431-4940-81a5-c338c0ddbbfe None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:26.673510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4a716-6431-4940-81a5-c338c0ddbbfe None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:26.679793 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4a716-6431-4940-81a5-c338c0ddbbfe None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:26.681304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4a716-6431-4940-81a5-c338c0ddbbfe None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:26.683391 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 83/163] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:26 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:26.689086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4a716-6431-4940-81a5-c338c0ddbbfe None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:26.730980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855222e-3fec-4bd4-a918-514aaa1d6605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:26.731746 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855222e-3fec-4bd4-a918-514aaa1d6605 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:26.732022 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855222e-3fec-4bd4-a918-514aaa1d6605 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:26.732293 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855222e-3fec-4bd4-a918-514aaa1d6605 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:26.749412 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855222e-3fec-4bd4-a918-514aaa1d6605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-7855222e-3fec-4bd4-a918-514aaa1d6605 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:26.762584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:26.763821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:26.764586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 81/164] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:26.775079 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855222e-3fec-4bd4-a918-514aaa1d6605 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:26.803371 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:26.852861 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4a716-6431-4940-81a5-c338c0ddbbfe None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:26.906228 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636e138-cf7c-4d9c-8dbd-84673ca084bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:26.906849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636e138-cf7c-4d9c-8dbd-84673ca084bc None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:26.907148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636e138-cf7c-4d9c-8dbd-84673ca084bc None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:26.907413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636e138-cf7c-4d9c-8dbd-84673ca084bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:26.933183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855222e-3fec-4bd4-a918-514aaa1d6605 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:26.962921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:27.013221 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36462e1e-a7ce-4481-ad79-23e62661afb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:27.013865 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462e1e-a7ce-4481-ad79-23e62661afb1 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.014135 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462e1e-a7ce-4481-ad79-23e62661afb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.014399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462e1e-a7ce-4481-ad79-23e62661afb1 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.015111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36462e1e-a7ce-4481-ad79-23e62661afb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:27.015414 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36462e1e-a7ce-4481-ad79-23e62661afb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:27.016840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36462e1e-a7ce-4481-ad79-23e62661afb1 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:27.041012 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 82/165] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:27.042128 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a3e0-235e-4ebe-9f25-f68b95312575 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.042408 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a3e0-235e-4ebe-9f25-f68b95312575 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.042699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a3e0-235e-4ebe-9f25-f68b95312575 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.043894 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 83/166] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:27.051357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74ff7-2127-49cc-aa32-db150334b233 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.051634 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74ff7-2127-49cc-aa32-db150334b233 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.051901 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74ff7-2127-49cc-aa32-db150334b233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.056884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636e138-cf7c-4d9c-8dbd-84673ca084bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:27.058370 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636e138-cf7c-4d9c-8dbd-84673ca084bc None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:27.099094 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-55a74ff7-2127-49cc-aa32-db150334b233 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:27.100304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-55a74ff7-2127-49cc-aa32-db150334b233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:27.218147 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 84/167] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:27.219103 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a74ff7-2127-49cc-aa32-db150334b233 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:27.230290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:27.290904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 84/168] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:26:27.297068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636e138-cf7c-4d9c-8dbd-84673ca084bc None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:27.387177 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:27.436921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a74ff7-2127-49cc-aa32-db150334b233 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:27.448656 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636e138-cf7c-4d9c-8dbd-84673ca084bc None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:27.508796 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924a35-5dab-4d99-9bd0-56cf322eb5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:27.509371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924a35-5dab-4d99-9bd0-56cf322eb5b9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.509641 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924a35-5dab-4d99-9bd0-56cf322eb5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.509906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924a35-5dab-4d99-9bd0-56cf322eb5b9 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.511073 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0924a35-5dab-4d99-9bd0-56cf322eb5b9 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:27.512553 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0924a35-5dab-4d99-9bd0-56cf322eb5b9 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:27.519177 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 85/169] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:27 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:27.520410 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924a35-5dab-4d99-9bd0-56cf322eb5b9 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:27.538194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd671b-9c66-48b2-91c7-bcb67dde4fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:27.538865 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd671b-9c66-48b2-91c7-bcb67dde4fe9 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.539287 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd671b-9c66-48b2-91c7-bcb67dde4fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.539454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd671b-9c66-48b2-91c7-bcb67dde4fe9 None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.540712 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd671b-9c66-48b2-91c7-bcb67dde4fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:27.542188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd671b-9c66-48b2-91c7-bcb67dde4fe9 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:27.544270 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 85/170] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:27 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:27.554713 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd671b-9c66-48b2-91c7-bcb67dde4fe9 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:27.657521 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924a35-5dab-4d99-9bd0-56cf322eb5b9 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:27.685157 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:27.693284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:27.693912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.694194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.694465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.695231 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] RBAC: Adding query filter params (role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=66d19a41099445d1876e9c42ba23261f, user.id=21f5b87c9ea84f509bfa337f93338038) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:27.695552 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:27.697000 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:27.703180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 86/171] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:27 2022] GET /identity/v3/role_assignments?user.id=21f5b87c9ea84f509bfa337f93338038&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:27.704066 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:27.781693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:27.834820 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd671b-9c66-48b2-91c7-bcb67dde4fe9 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:27.855456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd829d-9598-418a-9f6b-4dec1a38d617 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:27.916408 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26f471-732d-4d2a-bdbd-b7a2fc0410f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:27.917069 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26f471-732d-4d2a-bdbd-b7a2fc0410f6 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.917344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26f471-732d-4d2a-bdbd-b7a2fc0410f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.917611 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26f471-732d-4d2a-bdbd-b7a2fc0410f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.929179 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26f471-732d-4d2a-bdbd-b7a2fc0410f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-8a26f471-732d-4d2a-bdbd-b7a2fc0410f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:27.934510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:27.935724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:27.936578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 87/172] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:27.937710 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cddb1-16d5-4c06-bde3-bf52ba96730d None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.937710 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cddb1-16d5-4c06-bde3-bf52ba96730d None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.937970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cddb1-16d5-4c06-bde3-bf52ba96730d None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.939318 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 88/173] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:27.945051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05871-af2b-48de-8f1a-6bbb60ca22b5 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.945329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05871-af2b-48de-8f1a-6bbb60ca22b5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.945603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05871-af2b-48de-8f1a-6bbb60ca22b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.947758 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c4f0f-51a8-4742-8e33-9358a3d54465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:27.948451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c4f0f-51a8-4742-8e33-9358a3d54465 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:27.948733 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c4f0f-51a8-4742-8e33-9358a3d54465 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:27.949014 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c4f0f-51a8-4742-8e33-9358a3d54465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:27.964144 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-dfd05871-af2b-48de-8f1a-6bbb60ca22b5 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:27.965345 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-dfd05871-af2b-48de-8f1a-6bbb60ca22b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:28.023519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:28.043144 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 89/174] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:28.044489 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd05871-af2b-48de-8f1a-6bbb60ca22b5 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:28.107918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c4f0f-51a8-4742-8e33-9358a3d54465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:28.109492 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c4f0f-51a8-4742-8e33-9358a3d54465 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:28.181070 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd05871-af2b-48de-8f1a-6bbb60ca22b5 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:28.220852 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:28.221485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.221764 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.222036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.222718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:28.224717 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:28.226173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:28.235640 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 90/175] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:28.241621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:28.272914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:28.302937 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:28.314318 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 86/176] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:28.320072 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c4f0f-51a8-4742-8e33-9358a3d54465 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:28.367640 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2aaed-8fac-4567-8a32-133bdf884deb None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:28.407913 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3d56-8b3a-46b4-a6a4-e9876ce5a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:28.409472 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3d56-8b3a-46b4-a6a4-e9876ce5a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.409754 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3d56-8b3a-46b4-a6a4-e9876ce5a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.410022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3d56-8b3a-46b4-a6a4-e9876ce5a1b9 None admin] PATH_INFO: `/v3/users/21f5b87c9ea84f509bfa337f93338038` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.411245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d3d56-8b3a-46b4-a6a4-e9876ce5a1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=21f5b87c9ea84f509bfa337f93338038)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:28.412723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d3d56-8b3a-46b4-a6a4-e9876ce5a1b9 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:28.415129 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 91/177] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:28 2022] GET /identity/v3/users/21f5b87c9ea84f509bfa337f93338038 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:28.421074 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3d56-8b3a-46b4-a6a4-e9876ce5a1b9 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:28.533708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3d56-8b3a-46b4-a6a4-e9876ce5a1b9 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:28.548384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:28.571726 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0e576-b66e-4586-887e-bbaabbe2fa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:28.572358 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e576-b66e-4586-887e-bbaabbe2fa20 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.572638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e576-b66e-4586-887e-bbaabbe2fa20 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.572916 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e576-b66e-4586-887e-bbaabbe2fa20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.578354 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c4f0f-51a8-4742-8e33-9358a3d54465 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:28.631975 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd00ac-2fa6-460a-9544-269475046710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:28.632641 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd00ac-2fa6-460a-9544-269475046710 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.632918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd00ac-2fa6-460a-9544-269475046710 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.633190 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd00ac-2fa6-460a-9544-269475046710 None admin] PATH_INFO: `/v3/projects/2694d649515f485ca5a00097cfdaeeb0` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.634405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd00ac-2fa6-460a-9544-269475046710 None admin] RBAC: Authorizing `identity:get_project(project_id=2694d649515f485ca5a00097cfdaeeb0)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:28.636156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd00ac-2fa6-460a-9544-269475046710 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:28.638157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 87/178] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:28 2022] GET /identity/v3/projects/2694d649515f485ca5a00097cfdaeeb0 => generated 312 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:28.639512 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a78e4b-d86c-4045-9520-ade21c11382e None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.639797 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a78e4b-d86c-4045-9520-ade21c11382e None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.640068 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a78e4b-d86c-4045-9520-ade21c11382e None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.641484 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 88/179] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:28.642614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05907-2344-43fe-8473-2d5d9a23c51f None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.642890 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05907-2344-43fe-8473-2d5d9a23c51f None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.643276 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05907-2344-43fe-8473-2d5d9a23c51f None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.644383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 89/180] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:28.650009 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0e576-b66e-4586-887e-bbaabbe2fa20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:28.651734 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0e576-b66e-4586-887e-bbaabbe2fa20 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:28.655987 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05907-2344-43fe-8473-2d5d9a23c51f None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:28.706874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:28.778806 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 92/181] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:26:28.780218 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89630-8e3d-49d3-aaac-976dd13f0d5f None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.780512 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89630-8e3d-49d3-aaac-976dd13f0d5f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.780783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89630-8e3d-49d3-aaac-976dd13f0d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.781625 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05907-2344-43fe-8473-2d5d9a23c51f None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:28.798352 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-afa89630-8e3d-49d3-aaac-976dd13f0d5f None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:28.799591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-afa89630-8e3d-49d3-aaac-976dd13f0d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:28.806852 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:28.817970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1211901-2fc3-4fa7-b89b-04ee75845118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:28.818578 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1211901-2fc3-4fa7-b89b-04ee75845118 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.818846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1211901-2fc3-4fa7-b89b-04ee75845118 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.819133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1211901-2fc3-4fa7-b89b-04ee75845118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.819859 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1211901-2fc3-4fa7-b89b-04ee75845118 None admin] RBAC: Adding query filter params (role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=2694d649515f485ca5a00097cfdaeeb0, user.id=21f5b87c9ea84f509bfa337f93338038) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:28.820160 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1211901-2fc3-4fa7-b89b-04ee75845118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:28.821638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1211901-2fc3-4fa7-b89b-04ee75845118 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:28.839114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 90/182] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:28 2022] GET /identity/v3/role_assignments?user.id=21f5b87c9ea84f509bfa337f93338038&scope.project.id=2694d649515f485ca5a00097cfdaeeb0&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:28.839114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c51285-ec3b-4e6a-8ead-e4b230a6d622 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.839114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c51285-ec3b-4e6a-8ead-e4b230a6d622 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.839114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c51285-ec3b-4e6a-8ead-e4b230a6d622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.849427 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-17c51285-ec3b-4e6a-8ead-e4b230a6d622 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:28.850671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-17c51285-ec3b-4e6a-8ead-e4b230a6d622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:28.872888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 93/183] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:28.873561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89630-8e3d-49d3-aaac-976dd13f0d5f None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:28.929960 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 91/184] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:28.931771 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462dfe-4d51-4bbe-921a-2b67e64a66bd None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:28.932051 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462dfe-4d51-4bbe-921a-2b67e64a66bd None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:28.932321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04462dfe-4d51-4bbe-921a-2b67e64a66bd None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:28.933897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 92/185] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:28.934762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462dfe-4d51-4bbe-921a-2b67e64a66bd None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:28.986125 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.007544 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89630-8e3d-49d3-aaac-976dd13f0d5f None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.050113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f3499-d0b0-476d-9d68-005174c6ba75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.050756 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f3499-d0b0-476d-9d68-005174c6ba75 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.051061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f3499-d0b0-476d-9d68-005174c6ba75 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.051337 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f3499-d0b0-476d-9d68-005174c6ba75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.064069 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f3499-d0b0-476d-9d68-005174c6ba75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-dd4f3499-d0b0-476d-9d68-005174c6ba75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:29.070453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:29.071460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:29.072714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 94/186] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:29.074232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe05b0-afc3-4243-8923-e6c9c247f1b4 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.074232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe05b0-afc3-4243-8923-e6c9c247f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.074232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe05b0-afc3-4243-8923-e6c9c247f1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.076825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04462dfe-4d51-4bbe-921a-2b67e64a66bd None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.080779 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.096241 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-31fe05b0-afc3-4243-8923-e6c9c247f1b4 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:29.097295 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-31fe05b0-afc3-4243-8923-e6c9c247f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:29.119921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64987c80-c007-4b80-8eac-b95e61d2975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.120685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987c80-c007-4b80-8eac-b95e61d2975d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.121059 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987c80-c007-4b80-8eac-b95e61d2975d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.121333 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987c80-c007-4b80-8eac-b95e61d2975d None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.122532 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64987c80-c007-4b80-8eac-b95e61d2975d None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:29.124187 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64987c80-c007-4b80-8eac-b95e61d2975d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:29.125889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 93/187] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:28 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:29.126754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64987c80-c007-4b80-8eac-b95e61d2975d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.180559 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 95/188] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:29.181735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe05b0-afc3-4243-8923-e6c9c247f1b4 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.272119 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64987c80-c007-4b80-8eac-b95e61d2975d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.276946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.334408 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.335151 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.335431 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.335698 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.336394 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:29.336702 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:29.338147 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:29.348060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 94/189] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:29.348625 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.355215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe05b0-afc3-4243-8923-e6c9c247f1b4 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.387545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.392535 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.393987 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.395568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.395568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.395568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] RBAC: Adding query filter params (role.id=e7e1d965bd9b4d52a96f59ba3965c5ed, scope.project.id=66d19a41099445d1876e9c42ba23261f, user.id=21f5b87c9ea84f509bfa337f93338038) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:29.395826 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:29.398378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:29.406188 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 96/190] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/role_assignments?user.id=21f5b87c9ea84f509bfa337f93338038&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=e7e1d965bd9b4d52a96f59ba3965c5ed => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:29.407771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.469934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d772-fadd-4ac4-8a71-51b82e80c01b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.507589 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513f8d-033f-42d3-8f28-4764a969a7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.508241 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513f8d-033f-42d3-8f28-4764a969a7bb None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.508572 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513f8d-033f-42d3-8f28-4764a969a7bb None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.508773 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513f8d-033f-42d3-8f28-4764a969a7bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.521248 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d513f8d-033f-42d3-8f28-4764a969a7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-6d513f8d-033f-42d3-8f28-4764a969a7bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:29.527086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:29.528055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:29.528940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 95/191] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:29.529601 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513f8d-033f-42d3-8f28-4764a969a7bb None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.543438 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb0f9-47b2-4943-833c-57973769f7cc None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.561151 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.586220 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54660e8e-15eb-40d0-88e5-fed886bd07ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.587185 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660e8e-15eb-40d0-88e5-fed886bd07ef None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.587628 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660e8e-15eb-40d0-88e5-fed886bd07ef None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.588051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660e8e-15eb-40d0-88e5-fed886bd07ef None admin] PATH_INFO: `/v3/users/0cd110af900b421e922ea6834d0c9df2` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.605152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660e8e-15eb-40d0-88e5-fed886bd07ef None admin] RBAC: Authorizing `identity:get_user(user_id=0cd110af900b421e922ea6834d0c9df2)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:29.606899 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660e8e-15eb-40d0-88e5-fed886bd07ef None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:29.608853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 97/192] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/users/0cd110af900b421e922ea6834d0c9df2 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:29.609376 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54660e8e-15eb-40d0-88e5-fed886bd07ef None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.648399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513f8d-033f-42d3-8f28-4764a969a7bb None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.673129 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.690585 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7a3e-f1f2-49fc-b85f-6e323d38bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.691303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7a3e-f1f2-49fc-b85f-6e323d38bb6d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.691580 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7a3e-f1f2-49fc-b85f-6e323d38bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.691852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7a3e-f1f2-49fc-b85f-6e323d38bb6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.702652 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a7a3e-f1f2-49fc-b85f-6e323d38bb6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-451a7a3e-f1f2-49fc-b85f-6e323d38bb6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:29.708762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:29.709830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:29.710653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 96/193] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:29.711333 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7a3e-f1f2-49fc-b85f-6e323d38bb6d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.723114 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54660e8e-15eb-40d0-88e5-fed886bd07ef None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.757653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.758264 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.758541 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.758791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.759481 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:29.759782 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:29.761171 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:29.769828 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 98/194] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:29.770833 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.802292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.817700 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7a3e-f1f2-49fc-b85f-6e323d38bb6d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.852006 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62f2b-37c4-41e1-bde6-30b2d867d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.852655 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62f2b-37c4-41e1-bde6-30b2d867d33c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.852926 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62f2b-37c4-41e1-bde6-30b2d867d33c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.853192 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff62f2b-37c4-41e1-bde6-30b2d867d33c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.854288 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff62f2b-37c4-41e1-bde6-30b2d867d33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:29.855839 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff62f2b-37c4-41e1-bde6-30b2d867d33c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:29.857416 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 97/195] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:29.859539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62f2b-37c4-41e1-bde6-30b2d867d33c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:29.871053 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d2056-3d0d-4d3f-ac3f-6d4dc14085f8 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.887245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.905194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc87a-16e6-47ff-8641-c63f68f4e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.905813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc87a-16e6-47ff-8641-c63f68f4e41d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.906090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc87a-16e6-47ff-8641-c63f68f4e41d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.906359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc87a-16e6-47ff-8641-c63f68f4e41d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.956787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff62f2b-37c4-41e1-bde6-30b2d867d33c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:29.974916 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1cc87a-16e6-47ff-8641-c63f68f4e41d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:29.976429 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1cc87a-16e6-47ff-8641-c63f68f4e41d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:29.993296 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:29.993909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:29.994185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:29.994460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:29.995159 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:29.995459 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:29.996833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:30.004947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 98/196] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:30.007847 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.030219 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:30.082485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 99/197] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:30.083164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc87a-16e6-47ff-8641-c63f68f4e41d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.101193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:30.113022 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9b745-d652-4263-8087-c830b194e44f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:30.145580 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe968-49a3-4f82-a997-84a4ba2e72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:30.146220 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe968-49a3-4f82-a997-84a4ba2e72f7 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:30.146495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe968-49a3-4f82-a997-84a4ba2e72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:30.146763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe968-49a3-4f82-a997-84a4ba2e72f7 None admin] PATH_INFO: `/v3/users/1a5055e630574e86bd27e6b38a66cb17` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:30.147924 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe968-49a3-4f82-a997-84a4ba2e72f7 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5055e630574e86bd27e6b38a66cb17)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:30.149384 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe968-49a3-4f82-a997-84a4ba2e72f7 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:30.150967 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 99/198] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:30 2022] GET /identity/v3/users/1a5055e630574e86bd27e6b38a66cb17 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:30.151751 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe968-49a3-4f82-a997-84a4ba2e72f7 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.185884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc87a-16e6-47ff-8641-c63f68f4e41d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:30.218566 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456612-97aa-43e7-8df5-1cae4df4b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:30.219210 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456612-97aa-43e7-8df5-1cae4df4b297 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:30.219484 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456612-97aa-43e7-8df5-1cae4df4b297 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:30.219753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456612-97aa-43e7-8df5-1cae4df4b297 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:30.220391 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc456612-97aa-43e7-8df5-1cae4df4b297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:30.221854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc456612-97aa-43e7-8df5-1cae4df4b297 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:30.237388 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:30.242759 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 100/199] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:26:30 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:30.248265 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456612-97aa-43e7-8df5-1cae4df4b297 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.254750 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe968-49a3-4f82-a997-84a4ba2e72f7 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:30.292857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7edaa-27eb-4bb1-8baa-d55dfffd0113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:30.293563 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7edaa-27eb-4bb1-8baa-d55dfffd0113 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:30.293848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7edaa-27eb-4bb1-8baa-d55dfffd0113 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:30.294165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7edaa-27eb-4bb1-8baa-d55dfffd0113 None admin] PATH_INFO: `/v3/users/0cd110af900b421e922ea6834d0c9df2` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:30.295472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7edaa-27eb-4bb1-8baa-d55dfffd0113 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd110af900b421e922ea6834d0c9df2)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:30.296968 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7edaa-27eb-4bb1-8baa-d55dfffd0113 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:30.299175 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 100/200] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:30 2022] GET /identity/v3/users/0cd110af900b421e922ea6834d0c9df2 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:30.299996 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7edaa-27eb-4bb1-8baa-d55dfffd0113 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.332084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:30.378111 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456612-97aa-43e7-8df5-1cae4df4b297 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:30.415678 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a37d0a-4287-441b-9f76-54984eabe220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:30.416439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a37d0a-4287-441b-9f76-54984eabe220 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:30.416778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a37d0a-4287-441b-9f76-54984eabe220 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:30.417146 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a37d0a-4287-441b-9f76-54984eabe220 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:30.418318 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a37d0a-4287-441b-9f76-54984eabe220 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:30.419854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a37d0a-4287-441b-9f76-54984eabe220 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:30.421718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 101/201] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:30 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:30.422290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a37d0a-4287-441b-9f76-54984eabe220 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.429001 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7edaa-27eb-4bb1-8baa-d55dfffd0113 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:30.477180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56926a2b-836b-4c35-a881-3a24765e25c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:30.477802 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56926a2b-836b-4c35-a881-3a24765e25c1 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:30.478078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56926a2b-836b-4c35-a881-3a24765e25c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:30.478346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56926a2b-836b-4c35-a881-3a24765e25c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:30.504748 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:30.548932 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a37d0a-4287-441b-9f76-54984eabe220 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:30.573580 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56926a2b-836b-4c35-a881-3a24765e25c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:30.575124 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56926a2b-836b-4c35-a881-3a24765e25c1 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:30.594859 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43bf00-22d7-4b82-a255-f8f971f76023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:30.595548 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43bf00-22d7-4b82-a255-f8f971f76023 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:30.595823 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43bf00-22d7-4b82-a255-f8f971f76023 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:30.596091 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43bf00-22d7-4b82-a255-f8f971f76023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:30.607607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:30.692153 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43bf00-22d7-4b82-a255-f8f971f76023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:30.694216 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43bf00-22d7-4b82-a255-f8f971f76023 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:30.701992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 101/202] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:30.708082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56926a2b-836b-4c35-a881-3a24765e25c1 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.769627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:30.819688 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56926a2b-836b-4c35-a881-3a24765e25c1 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:30.841441 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 102/203] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:30.843056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43bf00-22d7-4b82-a255-f8f971f76023 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.862281 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:30.863379 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:30.863901 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:30.864505 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:30.865446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51, user.id=0cd110af900b421e922ea6834d0c9df2) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:30.865944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:30.867639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:30.874109 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 102/204] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:30 2022] GET /identity/v3/role_assignments?user.id=0cd110af900b421e922ea6834d0c9df2&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=22d22ddee1804d668628115534a289ab => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:30.875239 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:30.897003 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:30.973904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43bf00-22d7-4b82-a255-f8f971f76023 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:31.033648 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85192-7a83-448a-a1b5-9f34d5858b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:31.034680 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85192-7a83-448a-a1b5-9f34d5858b75 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:31.035514 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85192-7a83-448a-a1b5-9f34d5858b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:31.036869 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85192-7a83-448a-a1b5-9f34d5858b75 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:31.039891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c85192-7a83-448a-a1b5-9f34d5858b75 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:31.041650 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c85192-7a83-448a-a1b5-9f34d5858b75 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:31.048643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 103/205] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:30 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:31.055832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85192-7a83-448a-a1b5-9f34d5858b75 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:31.097765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35eec-d4b5-4d99-8b59-a06f0f3e0a4d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:31.133749 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:31.156001 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c274508-31b6-45c3-bccc-3a36fc85773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:31.156647 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c274508-31b6-45c3-bccc-3a36fc85773b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:31.156918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c274508-31b6-45c3-bccc-3a36fc85773b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:31.157185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c274508-31b6-45c3-bccc-3a36fc85773b None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:31.158429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c274508-31b6-45c3-bccc-3a36fc85773b None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:31.160068 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c274508-31b6-45c3-bccc-3a36fc85773b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:31.161709 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 103/206] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:30 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:31.167513 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c274508-31b6-45c3-bccc-3a36fc85773b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:31.205660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85192-7a83-448a-a1b5-9f34d5858b75 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:31.216074 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:31.256140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb8840-d055-4bc6-a109-04ed83d8cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:31.257083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8840-d055-4bc6-a109-04ed83d8cb02 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:31.257549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8840-d055-4bc6-a109-04ed83d8cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:31.258004 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8840-d055-4bc6-a109-04ed83d8cb02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:31.258964 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb8840-d055-4bc6-a109-04ed83d8cb02 None admin] RBAC: Adding query filter params (role.id=ad59177e2ed34618b4eddfa1ba66c8c5, scope.project.id=66d19a41099445d1876e9c42ba23261f, user.id=1a5055e630574e86bd27e6b38a66cb17) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:31.259482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb8840-d055-4bc6-a109-04ed83d8cb02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:31.261127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb8840-d055-4bc6-a109-04ed83d8cb02 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:31.267378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 104/207] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:31 2022] GET /identity/v3/role_assignments?user.id=1a5055e630574e86bd27e6b38a66cb17&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=ad59177e2ed34618b4eddfa1ba66c8c5 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:31.302461 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c274508-31b6-45c3-bccc-3a36fc85773b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:31.341670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772196c-9972-40b1-ac1e-42504ae76aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:31.342290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772196c-9972-40b1-ac1e-42504ae76aef None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:31.342919 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772196c-9972-40b1-ac1e-42504ae76aef None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:31.343221 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772196c-9972-40b1-ac1e-42504ae76aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:31.343962 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772196c-9972-40b1-ac1e-42504ae76aef None admin] RBAC: Adding query filter params (role.id=e7e1d965bd9b4d52a96f59ba3965c5ed, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51, user.id=0cd110af900b421e922ea6834d0c9df2) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:31.344336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772196c-9972-40b1-ac1e-42504ae76aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:31.345838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772196c-9972-40b1-ac1e-42504ae76aef None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:31.352548 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 104/208] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:31 2022] GET /identity/v3/role_assignments?user.id=0cd110af900b421e922ea6834d0c9df2&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=e7e1d965bd9b4d52a96f59ba3965c5ed => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:32.653182 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bd38-0508-4350-8179-374962cfba8a None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:32.653798 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bd38-0508-4350-8179-374962cfba8a None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:32.653798 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bd38-0508-4350-8179-374962cfba8a None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:32.655147 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 105/209] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:32.660918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6e0b-f07b-45c0-8527-55e61c57bc49 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:32.661370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6e0b-f07b-45c0-8527-55e61c57bc49 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:32.661476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6e0b-f07b-45c0-8527-55e61c57bc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:32.680325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-a66b6e0b-f07b-45c0-8527-55e61c57bc49 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:32.681515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-a66b6e0b-f07b-45c0-8527-55e61c57bc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:32.733543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:32.759055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 105/210] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:32.877530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e633b-b212-4383-b900-591001cb9f4e None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:32.878168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e633b-b212-4383-b900-591001cb9f4e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:32.878638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e633b-b212-4383-b900-591001cb9f4e None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:32.880221 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 106/211] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:32.885829 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00da80-5a93-44e0-baee-75cf5257491c None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:32.886101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00da80-5a93-44e0-baee-75cf5257491c None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:32.886599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00da80-5a93-44e0-baee-75cf5257491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:32.905437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-6c00da80-5a93-44e0-baee-75cf5257491c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:32.906902 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-6c00da80-5a93-44e0-baee-75cf5257491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:32.975043 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 106/212] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:33.087320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e633b-b212-4383-b900-591001cb9f4e None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:33.203635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e633b-b212-4383-b900-591001cb9f4e None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:33.238638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3032ef-c375-4a1d-9dc0-ed661893fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:33.239306 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3032ef-c375-4a1d-9dc0-ed661893fe46 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.239578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3032ef-c375-4a1d-9dc0-ed661893fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.239842 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3032ef-c375-4a1d-9dc0-ed661893fe46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.250738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3032ef-c375-4a1d-9dc0-ed661893fe46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-0c3032ef-c375-4a1d-9dc0-ed661893fe46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:33.255635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:33.256519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:33.257284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 107/213] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:33.264392 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00da80-5a93-44e0-baee-75cf5257491c None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:33.274223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d590-fe7f-4612-9da8-55b1d8eeebbe None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.274223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d590-fe7f-4612-9da8-55b1d8eeebbe None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.274457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d590-fe7f-4612-9da8-55b1d8eeebbe None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.276029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 108/214] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:33.281044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4a316-6e14-423d-8092-eb0abcacc7ae None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.281324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4a316-6e14-423d-8092-eb0abcacc7ae None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.281649 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4a316-6e14-423d-8092-eb0abcacc7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.302094 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-90e4a316-6e14-423d-8092-eb0abcacc7ae None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:33.304166 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-90e4a316-6e14-423d-8092-eb0abcacc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:33.334914 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:33.373962 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00da80-5a93-44e0-baee-75cf5257491c None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:33.379323 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 109/215] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:33.380311 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4a316-6e14-423d-8092-eb0abcacc7ae None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:33.389215 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:33.424829 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:33.425457 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.425730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.425996 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.426669 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:33.427433 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:33.429244 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:33.444992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 107/216] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:33.446186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:33.500570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4a316-6e14-423d-8092-eb0abcacc7ae None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:33.536531 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7dce-c949-4e39-a3c3-e9502b096813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:33.537615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7dce-c949-4e39-a3c3-e9502b096813 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.538086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7dce-c949-4e39-a3c3-e9502b096813 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.538549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7dce-c949-4e39-a3c3-e9502b096813 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.540083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d7dce-c949-4e39-a3c3-e9502b096813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:33.541866 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d7dce-c949-4e39-a3c3-e9502b096813 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:33.545115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 110/217] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:33.555044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7dce-c949-4e39-a3c3-e9502b096813 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:33.570169 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005ce8b-fa3d-4b65-9622-9e771126a6c8 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:33.599383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:33.614127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400365df-6cbe-440d-b30e-8041a32ddcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:33.614952 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400365df-6cbe-440d-b30e-8041a32ddcd6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.615240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400365df-6cbe-440d-b30e-8041a32ddcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.615878 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400365df-6cbe-440d-b30e-8041a32ddcd6 None admin] PATH_INFO: `/v3/users/9286b4ead54049c5889381c2fc9a789b` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.630838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400365df-6cbe-440d-b30e-8041a32ddcd6 None admin] RBAC: Authorizing `identity:get_user(user_id=9286b4ead54049c5889381c2fc9a789b)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:33.632475 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400365df-6cbe-440d-b30e-8041a32ddcd6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:33.634580 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 108/218] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:33 2022] GET /identity/v3/users/9286b4ead54049c5889381c2fc9a789b => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:33.644824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400365df-6cbe-440d-b30e-8041a32ddcd6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:33.666546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7dce-c949-4e39-a3c3-e9502b096813 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:33.684052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:33.709581 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e57134-e89b-4b3e-ad79-d3cce9133030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:33.710224 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e57134-e89b-4b3e-ad79-d3cce9133030 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.710497 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e57134-e89b-4b3e-ad79-d3cce9133030 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.710813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e57134-e89b-4b3e-ad79-d3cce9133030 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.711497 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e57134-e89b-4b3e-ad79-d3cce9133030 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:33.712932 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e57134-e89b-4b3e-ad79-d3cce9133030 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:33.735886 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 111/219] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:26:33 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:33.736707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e57134-e89b-4b3e-ad79-d3cce9133030 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:33.773958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400365df-6cbe-440d-b30e-8041a32ddcd6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:33.815730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a683f-2f30-4d69-922c-a3fb1ad7dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:33.816029 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a683f-2f30-4d69-922c-a3fb1ad7dec2 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.816304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a683f-2f30-4d69-922c-a3fb1ad7dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.816574 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a683f-2f30-4d69-922c-a3fb1ad7dec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.836452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:33.857291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e57134-e89b-4b3e-ad79-d3cce9133030 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:33.894215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae4ed-a20f-41b8-858d-72dfc7d8596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:33.894864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae4ed-a20f-41b8-858d-72dfc7d8596c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.895191 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae4ed-a20f-41b8-858d-72dfc7d8596c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.895465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae4ed-a20f-41b8-858d-72dfc7d8596c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.896290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a683f-2f30-4d69-922c-a3fb1ad7dec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:33.897820 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a683f-2f30-4d69-922c-a3fb1ad7dec2 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:33.907238 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bae4ed-a20f-41b8-858d-72dfc7d8596c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-10bae4ed-a20f-41b8-858d-72dfc7d8596c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:33.913289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:33.914422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:33.915388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 112/220] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:33.916046 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdedd9b-c6e8-462c-9693-2d0348bfcb1e None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:33.916250 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdedd9b-c6e8-462c-9693-2d0348bfcb1e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:33.916554 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdedd9b-c6e8-462c-9693-2d0348bfcb1e None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:33.918019 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 113/221] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:33.922896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdedd9b-c6e8-462c-9693-2d0348bfcb1e None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:33.938414 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:34.033555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 109/222] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:34.034775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007553e-0d4b-436b-a2c8-70ec59d6d134 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:34.035087 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007553e-0d4b-436b-a2c8-70ec59d6d134 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:34.035339 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007553e-0d4b-436b-a2c8-70ec59d6d134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:34.056013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-f007553e-0d4b-436b-a2c8-70ec59d6d134 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:34.056200 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdedd9b-c6e8-462c-9693-2d0348bfcb1e None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:34.056564 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-f007553e-0d4b-436b-a2c8-70ec59d6d134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:34.099944 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:34.100559 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:34.100831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:34.101099 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:34.101771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:34.102077 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:34.103507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:34.120176 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 114/223] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:34.121053 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:34.142239 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:34.154349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 110/224] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:34.155991 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007553e-0d4b-436b-a2c8-70ec59d6d134 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:34.273264 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2101-4b3a-4eb9-ad24-372eea9c3905 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:34.296663 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:34.313114 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb157f-e9b4-4b50-81cf-6285d79ad246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:34.313817 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb157f-e9b4-4b50-81cf-6285d79ad246 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:34.314097 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb157f-e9b4-4b50-81cf-6285d79ad246 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:34.314367 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb157f-e9b4-4b50-81cf-6285d79ad246 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:34.315661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb157f-e9b4-4b50-81cf-6285d79ad246 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:34.317740 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb157f-e9b4-4b50-81cf-6285d79ad246 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:34.320116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 115/225] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:34 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:34.340444 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb157f-e9b4-4b50-81cf-6285d79ad246 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:34.359596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007553e-0d4b-436b-a2c8-70ec59d6d134 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:34.396486 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85cf2-c99c-444f-9d6a-cdd5a858df8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:34.397497 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85cf2-c99c-444f-9d6a-cdd5a858df8d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:34.398001 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85cf2-c99c-444f-9d6a-cdd5a858df8d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:34.398466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85cf2-c99c-444f-9d6a-cdd5a858df8d None admin] PATH_INFO: `/v3/users/0cd110af900b421e922ea6834d0c9df2` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:34.399837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a85cf2-c99c-444f-9d6a-cdd5a858df8d None admin] RBAC: Authorizing `identity:get_user(user_id=0cd110af900b421e922ea6834d0c9df2)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:34.401517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a85cf2-c99c-444f-9d6a-cdd5a858df8d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:34.403479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 111/226] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:34 2022] GET /identity/v3/users/0cd110af900b421e922ea6834d0c9df2 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:34.409208 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85cf2-c99c-444f-9d6a-cdd5a858df8d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:34.499187 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:34.545914 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb157f-e9b4-4b50-81cf-6285d79ad246 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:34.590259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85cf2-c99c-444f-9d6a-cdd5a858df8d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:34.609906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:34.610607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:34.610802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:34.611116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:34.611838 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] RBAC: Adding query filter params (role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51, user.id=9286b4ead54049c5889381c2fc9a789b) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:34.612140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:34.613590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:34.627052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 116/227] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:34 2022] GET /identity/v3/role_assignments?user.id=9286b4ead54049c5889381c2fc9a789b&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:34.627052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:34.646236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:34.661843 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746a21-3655-4927-bd90-497a6f3bd07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:34.662510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746a21-3655-4927-bd90-497a6f3bd07f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:34.663029 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746a21-3655-4927-bd90-497a6f3bd07f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:34.663370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746a21-3655-4927-bd90-497a6f3bd07f None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:34.664638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8746a21-3655-4927-bd90-497a6f3bd07f None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:34.666139 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8746a21-3655-4927-bd90-497a6f3bd07f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:34.668243 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 112/228] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:34 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:34.675410 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746a21-3655-4927-bd90-497a6f3bd07f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:34.822001 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e644941-697f-4dd2-8ddd-664c4f2cef3d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:34.867824 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3110e0-21d8-4947-aa30-61a82ea32887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:34.868052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3110e0-21d8-4947-aa30-61a82ea32887 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:34.868324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3110e0-21d8-4947-aa30-61a82ea32887 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:34.868592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3110e0-21d8-4947-aa30-61a82ea32887 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:34.879844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:34.883514 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3110e0-21d8-4947-aa30-61a82ea32887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:34.884478 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746a21-3655-4927-bd90-497a6f3bd07f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-da3110e0-21d8-4947-aa30-61a82ea32887 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:34.889860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:34.890776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:34.891661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:34.894240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 117/229] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:34.901807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3110e0-21d8-4947-aa30-61a82ea32887 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:34.956317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecc6b-76a6-4143-bc09-465953073ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:34.958100 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecc6b-76a6-4143-bc09-465953073ad5 None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:34.958676 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecc6b-76a6-4143-bc09-465953073ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:34.960932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecc6b-76a6-4143-bc09-465953073ad5 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/users/0cd110af900b421e922ea6834d0c9df2/roles/22d22ddee1804d668628115534a289ab` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:34.963289 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fecc6b-76a6-4143-bc09-465953073ad5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51, user_id=0cd110af900b421e922ea6834d0c9df2, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:34.965708 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fecc6b-76a6-4143-bc09-465953073ad5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:34.990984 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 113/230] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:34 2022] PUT /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/users/0cd110af900b421e922ea6834d0c9df2/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:26:35.063673 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3110e0-21d8-4947-aa30-61a82ea32887 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:35.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:35.117208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:35.117736 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:35.118204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:35.119063 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:35.119578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:35.121321 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:35.135317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 118/231] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:35.141378 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecc6b-76a6-4143-bc09-465953073ad5 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:35.217347 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:35.273479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecc6b-76a6-4143-bc09-465953073ad5 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:35.308490 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e022-0fb1-4ec8-9ebc-5345ca2285fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:35.309375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e022-0fb1-4ec8-9ebc-5345ca2285fe None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:35.309857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e022-0fb1-4ec8-9ebc-5345ca2285fe None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:35.310267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e022-0fb1-4ec8-9ebc-5345ca2285fe None admin] PATH_INFO: `/v3/users/0cd110af900b421e922ea6834d0c9df2` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:35.311582 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9e022-0fb1-4ec8-9ebc-5345ca2285fe None admin] RBAC: Authorizing `identity:get_user(user_id=0cd110af900b421e922ea6834d0c9df2)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:35.313179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9e022-0fb1-4ec8-9ebc-5345ca2285fe None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:35.314983 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 114/232] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:35 2022] GET /identity/v3/users/0cd110af900b421e922ea6834d0c9df2 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:35.321224 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:35.390909 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:35.439181 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a33a0-d35e-4238-a318-583a565ce6bb None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:35.491039 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a77d47-7167-4b30-ae80-74c937a728ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:35.491933 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77d47-7167-4b30-ae80-74c937a728ea None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:35.492387 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77d47-7167-4b30-ae80-74c937a728ea None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:35.492850 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77d47-7167-4b30-ae80-74c937a728ea None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:35.495685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77d47-7167-4b30-ae80-74c937a728ea None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:35.502746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77d47-7167-4b30-ae80-74c937a728ea None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:35.504707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 119/233] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:35 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:35.511365 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e022-0fb1-4ec8-9ebc-5345ca2285fe None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:35.617250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e022-0fb1-4ec8-9ebc-5345ca2285fe None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:35.640452 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:35.652397 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95791713-5834-464e-a66a-fb3b5ce5999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:35.653671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791713-5834-464e-a66a-fb3b5ce5999c None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:35.654444 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791713-5834-464e-a66a-fb3b5ce5999c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:35.654720 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791713-5834-464e-a66a-fb3b5ce5999c None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/users/0cd110af900b421e922ea6834d0c9df2/roles/e7e1d965bd9b4d52a96f59ba3965c5ed` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:35.656909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95791713-5834-464e-a66a-fb3b5ce5999c None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51, user_id=0cd110af900b421e922ea6834d0c9df2, role_id=e7e1d965bd9b4d52a96f59ba3965c5ed)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:35.658382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95791713-5834-464e-a66a-fb3b5ce5999c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:35.684686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 115/234] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:35 2022] PUT /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/users/0cd110af900b421e922ea6834d0c9df2/roles/e7e1d965bd9b4d52a96f59ba3965c5ed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:36.376286 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481d2a-bdc8-4730-91fa-5448cfb5e779 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:36.376837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481d2a-bdc8-4730-91fa-5448cfb5e779 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:36.376837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481d2a-bdc8-4730-91fa-5448cfb5e779 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:36.378151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 120/235] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:36.383791 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade5e0-d7d9-4671-98c4-d8ef66e69715 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:36.384228 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade5e0-d7d9-4671-98c4-d8ef66e69715 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:36.384396 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade5e0-d7d9-4671-98c4-d8ef66e69715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:36.396151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2fce5-e603-4b4f-96c1-91c58beed173 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:36.396426 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2fce5-e603-4b4f-96c1-91c58beed173 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:36.396686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2fce5-e603-4b4f-96c1-91c58beed173 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:36.398153 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 121/236] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:36.411208 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b8ade5e0-d7d9-4671-98c4-d8ef66e69715 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:36.411880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb5e9-075e-4f97-8ca8-b02f5fff255d None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:36.412168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb5e9-075e-4f97-8ca8-b02f5fff255d None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:36.412418 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b8ade5e0-d7d9-4671-98c4-d8ef66e69715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:36.412542 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb5e9-075e-4f97-8ca8-b02f5fff255d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:36.456669 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-242cb5e9-075e-4f97-8ca8-b02f5fff255d None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:36.458036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-242cb5e9-075e-4f97-8ca8-b02f5fff255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:36.519989 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 116/237] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:36.544984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 122/238] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:37.007129 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ade5e0-d7d9-4671-98c4-d8ef66e69715 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:37.058210 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cb5e9-075e-4f97-8ca8-b02f5fff255d None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:37.130840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ade5e0-d7d9-4671-98c4-d8ef66e69715 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:37.146455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:37.172329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:37.173046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1091b1-6fc7-41bb-baa8-46e3fbb0e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:37.174105 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1091b1-6fc7-41bb-baa8-46e3fbb0e31e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.174384 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1091b1-6fc7-41bb-baa8-46e3fbb0e31e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.174659 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1091b1-6fc7-41bb-baa8-46e3fbb0e31e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.176043 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1091b1-6fc7-41bb-baa8-46e3fbb0e31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:37.178714 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1091b1-6fc7-41bb-baa8-46e3fbb0e31e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:37.180709 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 117/239] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:37.186554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1091b1-6fc7-41bb-baa8-46e3fbb0e31e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:37.255092 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cb5e9-075e-4f97-8ca8-b02f5fff255d None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:37.330034 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a318f-2f57-4a5f-a6fc-8aa6f250eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:37.334384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a318f-2f57-4a5f-a6fc-8aa6f250eba0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.334864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a318f-2f57-4a5f-a6fc-8aa6f250eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.335369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a318f-2f57-4a5f-a6fc-8aa6f250eba0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.360610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a318f-2f57-4a5f-a6fc-8aa6f250eba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-778a318f-2f57-4a5f-a6fc-8aa6f250eba0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:37.366689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:37.367621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:37.368406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:37.372526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 123/240] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:37.381490 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a318f-2f57-4a5f-a6fc-8aa6f250eba0 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:37.391077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1091b1-6fc7-41bb-baa8-46e3fbb0e31e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:37.444853 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79b328-565f-42ec-90f2-af49eebf7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:37.445872 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b328-565f-42ec-90f2-af49eebf7c39 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.446434 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b328-565f-42ec-90f2-af49eebf7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.446916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b328-565f-42ec-90f2-af49eebf7c39 None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.447889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79b328-565f-42ec-90f2-af49eebf7c39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:37.449524 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79b328-565f-42ec-90f2-af49eebf7c39 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:37.474823 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 118/241] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:26:37 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:37.476615 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be5d7-7e8d-48b8-8c29-99ada8962b4f None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.477240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be5d7-7e8d-48b8-8c29-99ada8962b4f None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.478068 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be5d7-7e8d-48b8-8c29-99ada8962b4f None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.479756 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 119/242] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:37.484389 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a318f-2f57-4a5f-a6fc-8aa6f250eba0 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:37.486352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a0639-85df-4459-b9a4-a63fd056dc1a None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.486893 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a0639-85df-4459-b9a4-a63fd056dc1a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.487488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a0639-85df-4459-b9a4-a63fd056dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.507869 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:37.510509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-4f4a0639-85df-4459-b9a4-a63fd056dc1a None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:37.512436 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-4f4a0639-85df-4459-b9a4-a63fd056dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:37.522533 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:37.523719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.523719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.523719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.524598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:37.524907 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:37.526318 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:37.540610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 124/243] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:37.542199 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:37.551049 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:37.599035 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 120/244] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:37.681959 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294571bd-7784-412e-91b1-6438833cd338 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:37.719976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eec2e1-815e-45e8-8705-65c825b62044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:37.720637 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec2e1-815e-45e8-8705-65c825b62044 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.720917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec2e1-815e-45e8-8705-65c825b62044 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.721193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec2e1-815e-45e8-8705-65c825b62044 None admin] PATH_INFO: `/v3/users/3c252764ae5b4e0ea9f5dfbfeb4dba4d` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.736823 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eec2e1-815e-45e8-8705-65c825b62044 None admin] RBAC: Authorizing `identity:get_user(user_id=3c252764ae5b4e0ea9f5dfbfeb4dba4d)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:37.738321 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eec2e1-815e-45e8-8705-65c825b62044 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:37.740044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 125/245] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:37 2022] GET /identity/v3/users/3c252764ae5b4e0ea9f5dfbfeb4dba4d => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:37.745864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a0639-85df-4459-b9a4-a63fd056dc1a None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:37.856765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a0639-85df-4459-b9a4-a63fd056dc1a None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:37.903182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5564e-6535-416e-8281-391a0f2b9cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:37.904263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5564e-6535-416e-8281-391a0f2b9cf2 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.904756 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5564e-6535-416e-8281-391a0f2b9cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.905214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5564e-6535-416e-8281-391a0f2b9cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.948483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:37.950694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c2e8d-1f20-4fb3-a985-66f4c6cfa446 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.950959 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c2e8d-1f20-4fb3-a985-66f4c6cfa446 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.951293 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c2e8d-1f20-4fb3-a985-66f4c6cfa446 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.952831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 126/246] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:37.958318 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c6065-3e80-4d49-83cc-b86581165ba0 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:37.958596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c6065-3e80-4d49-83cc-b86581165ba0 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:37.958866 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c6065-3e80-4d49-83cc-b86581165ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:37.983958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-012c6065-3e80-4d49-83cc-b86581165ba0 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:37.984902 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-012c6065-3e80-4d49-83cc-b86581165ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:37.990415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5564e-6535-416e-8281-391a0f2b9cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:37.992306 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5564e-6535-416e-8281-391a0f2b9cf2 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:38.036385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:38.094405 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 127/247] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:38.094405 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c6065-3e80-4d49-83cc-b86581165ba0 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:38.122210 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 121/248] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:38.125396 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5564e-6535-416e-8281-391a0f2b9cf2 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:38.215808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:38.246707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c6065-3e80-4d49-83cc-b86581165ba0 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:38.269450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5564e-6535-416e-8281-391a0f2b9cf2 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:38.289512 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbb87f-e5b9-46b5-93e0-44b989479f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:38.290457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb87f-e5b9-46b5-93e0-44b989479f79 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.290740 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb87f-e5b9-46b5-93e0-44b989479f79 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.291065 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb87f-e5b9-46b5-93e0-44b989479f79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbb87f-e5b9-46b5-93e0-44b989479f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-14dbb87f-e5b9-46b5-93e0-44b989479f79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:38.311022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:38.311879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:38.312727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 128/249] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:38.316911 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbb87f-e5b9-46b5-93e0-44b989479f79 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:38.318418 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923ba81-9103-4e18-9a55-5ccd85d39609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:38.319366 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923ba81-9103-4e18-9a55-5ccd85d39609 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.319940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923ba81-9103-4e18-9a55-5ccd85d39609 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.320395 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923ba81-9103-4e18-9a55-5ccd85d39609 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.322437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923ba81-9103-4e18-9a55-5ccd85d39609 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:38.324275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923ba81-9103-4e18-9a55-5ccd85d39609 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:38.326523 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 122/250] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:38.333269 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923ba81-9103-4e18-9a55-5ccd85d39609 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:38.359355 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:38.487607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbb87f-e5b9-46b5-93e0-44b989479f79 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:38.528414 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923ba81-9103-4e18-9a55-5ccd85d39609 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:38.555757 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:38.556388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.556659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.556923 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.557597 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] RBAC: Adding query filter params (name=member) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:38.557897 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:38.559310 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:38.564627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:38.565241 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.565512 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.565772 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.566498 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] RBAC: Adding query filter params (role.id=ad59177e2ed34618b4eddfa1ba66c8c5, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51, user.id=3c252764ae5b4e0ea9f5dfbfeb4dba4d) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:38.566801 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:38.568260 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:38.568854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 129/251] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:38.570124 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:38.575101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 123/252] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/role_assignments?user.id=3c252764ae5b4e0ea9f5dfbfeb4dba4d&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=ad59177e2ed34618b4eddfa1ba66c8c5 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:38.576512 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:38.605685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:38.726551 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25cd9b-b9df-464d-a888-4e7f7471e497 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:38.749321 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:38.765258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816b130-e501-4ab4-84b9-f50eb86b8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:38.766155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b130-e501-4ab4-84b9-f50eb86b8f57 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.766557 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b130-e501-4ab4-84b9-f50eb86b8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.766973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b130-e501-4ab4-84b9-f50eb86b8f57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.767311 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1ae2e-13e5-430c-b131-5a13b22496ee None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:38.781753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816b130-e501-4ab4-84b9-f50eb86b8f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-d816b130-e501-4ab4-84b9-f50eb86b8f57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:38.787476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:38.788618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:38.789627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:38.792075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 124/253] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:38.798553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f8c0-bed8-4966-86ee-ddd26e765780 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.799113 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f8c0-bed8-4966-86ee-ddd26e765780 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.799531 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f8c0-bed8-4966-86ee-ddd26e765780 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.801360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 125/254] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:38.802276 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f8c0-bed8-4966-86ee-ddd26e765780 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:38.839112 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890279e0-6ad4-42b4-a545-33734a51a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:38.840202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890279e0-6ad4-42b4-a545-33734a51a871 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.840961 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890279e0-6ad4-42b4-a545-33734a51a871 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.841638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890279e0-6ad4-42b4-a545-33734a51a871 None admin] PATH_INFO: `/v3/users/9286b4ead54049c5889381c2fc9a789b` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.843602 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890279e0-6ad4-42b4-a545-33734a51a871 None admin] RBAC: Authorizing `identity:get_user(user_id=9286b4ead54049c5889381c2fc9a789b)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:38.845496 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890279e0-6ad4-42b4-a545-33734a51a871 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:38.848096 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 130/255] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/users/9286b4ead54049c5889381c2fc9a789b => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:38.849429 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753c6e-3bc5-4222-bef2-6858b116ec52 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.849856 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753c6e-3bc5-4222-bef2-6858b116ec52 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.850299 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753c6e-3bc5-4222-bef2-6858b116ec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.873317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-95753c6e-3bc5-4222-bef2-6858b116ec52 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:38.875372 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-95753c6e-3bc5-4222-bef2-6858b116ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:38.883349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:38.920046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f8c0-bed8-4966-86ee-ddd26e765780 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:38.956889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:38.957786 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:38.958470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:38.958635 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:38.959443 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:38.959842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:38.961355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:38.964297 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 131/256] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:38.965328 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95753c6e-3bc5-4222-bef2-6858b116ec52 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:38.979490 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 126/257] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:38.987323 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:39.073772 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:39.084982 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95753c6e-3bc5-4222-bef2-6858b116ec52 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:39.125014 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e069-2cfc-4f15-83a4-09fa2b80219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:39.126016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e069-2cfc-4f15-83a4-09fa2b80219e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:39.126433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e069-2cfc-4f15-83a4-09fa2b80219e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:39.126871 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e069-2cfc-4f15-83a4-09fa2b80219e None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:39.128308 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18e069-2cfc-4f15-83a4-09fa2b80219e None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:39.130757 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18e069-2cfc-4f15-83a4-09fa2b80219e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:39.132616 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 132/258] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:39.140436 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e069-2cfc-4f15-83a4-09fa2b80219e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:39.208413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a72886-6f00-4753-876e-534167522af2 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:39.249470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:39.258170 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e069-2cfc-4f15-83a4-09fa2b80219e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:39.300790 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec215f5-a600-4188-80fa-ed46acc97a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:39.301456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec215f5-a600-4188-80fa-ed46acc97a73 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:39.301787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec215f5-a600-4188-80fa-ed46acc97a73 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:39.301981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec215f5-a600-4188-80fa-ed46acc97a73 None admin] PATH_INFO: `/v3/users/0cd110af900b421e922ea6834d0c9df2` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:39.305966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e90a-9847-4e17-ab72-051507740e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:39.306916 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e90a-9847-4e17-ab72-051507740e20 None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:39.307487 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e90a-9847-4e17-ab72-051507740e20 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:39.307949 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e90a-9847-4e17-ab72-051507740e20 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/users/9286b4ead54049c5889381c2fc9a789b/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:39.308136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec215f5-a600-4188-80fa-ed46acc97a73 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd110af900b421e922ea6834d0c9df2)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:39.310361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3e90a-9847-4e17-ab72-051507740e20 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51, user_id=9286b4ead54049c5889381c2fc9a789b, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:39.310687 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec215f5-a600-4188-80fa-ed46acc97a73 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:39.312303 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3e90a-9847-4e17-ab72-051507740e20 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:39.312821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 127/259] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:38 2022] GET /identity/v3/users/0cd110af900b421e922ea6834d0c9df2 => generated 283 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:39.323526 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec215f5-a600-4188-80fa-ed46acc97a73 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:39.339567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 133/260] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:39 2022] PUT /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/users/9286b4ead54049c5889381c2fc9a789b/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:39.460710 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec215f5-a600-4188-80fa-ed46acc97a73 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:39.469914 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e90a-9847-4e17-ab72-051507740e20 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:39.507588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe465-52c9-40c1-921d-71a6efd63812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:39.508540 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe465-52c9-40c1-921d-71a6efd63812 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:39.508815 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe465-52c9-40c1-921d-71a6efd63812 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:39.509084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe465-52c9-40c1-921d-71a6efd63812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:39.513709 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:39.624232 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:39.660130 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe465-52c9-40c1-921d-71a6efd63812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:39.661874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe465-52c9-40c1-921d-71a6efd63812 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:39.684339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e90a-9847-4e17-ab72-051507740e20 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:39.754956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f6962-17df-4963-a988-d9758da67cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:39.755871 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f6962-17df-4963-a988-d9758da67cf2 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:39.756384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f6962-17df-4963-a988-d9758da67cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:39.756781 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f6962-17df-4963-a988-d9758da67cf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:39.786931 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f6962-17df-4963-a988-d9758da67cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-356f6962-17df-4963-a988-d9758da67cf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:39.795214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:39.796276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:39.797232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:39.800926 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 134/261] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:39.811978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f6962-17df-4963-a988-d9758da67cf2 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:39.884684 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 128/262] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:39.890005 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe465-52c9-40c1-921d-71a6efd63812 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:39.941242 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:39.976929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f6962-17df-4963-a988-d9758da67cf2 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:40.039948 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:40.040558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:40.040832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:40.041139 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:40.041808 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:40.042141 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:40.043672 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:40.056179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:40.063078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 135/263] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:40.069793 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:40.077909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe465-52c9-40c1-921d-71a6efd63812 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:40.117509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065143e-c972-494f-bdbc-c328d8a34ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:40.118162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065143e-c972-494f-bdbc-c328d8a34ce5 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:40.118430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065143e-c972-494f-bdbc-c328d8a34ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:40.118694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065143e-c972-494f-bdbc-c328d8a34ce5 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:40.120614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065143e-c972-494f-bdbc-c328d8a34ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:40.122073 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065143e-c972-494f-bdbc-c328d8a34ce5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:40.124040 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 129/264] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:39 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:40.129995 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065143e-c972-494f-bdbc-c328d8a34ce5 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:40.258963 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547082a-7c68-41e1-928e-78d4178b7c69 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:40.260468 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065143e-c972-494f-bdbc-c328d8a34ce5 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:40.294504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:40.295150 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:40.295425 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:40.295689 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:40.296403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51, user.id=0cd110af900b421e922ea6834d0c9df2) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:40.296701 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:40.298136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:40.304420 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 130/265] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:40 2022] GET /identity/v3/role_assignments?user.id=0cd110af900b421e922ea6834d0c9df2&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=22d22ddee1804d668628115534a289ab => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:40.314658 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0b91a-768f-4180-b4d1-9c327120b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:40.315337 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b91a-768f-4180-b4d1-9c327120b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:40.315609 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b91a-768f-4180-b4d1-9c327120b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:40.315877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b91a-768f-4180-b4d1-9c327120b5e9 None admin] PATH_INFO: `/v3/users/0cd110af900b421e922ea6834d0c9df2` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:40.317008 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0b91a-768f-4180-b4d1-9c327120b5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd110af900b421e922ea6834d0c9df2)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:40.318570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0b91a-768f-4180-b4d1-9c327120b5e9 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:40.320278 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 136/266] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:40 2022] GET /identity/v3/users/0cd110af900b421e922ea6834d0c9df2 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:40.326488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:40.367393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:40.437139 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747730-d7d7-43d9-a262-17e3089ad55f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:40.473391 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048943d-ba66-4237-838a-87a4c8493da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:40.474014 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048943d-ba66-4237-838a-87a4c8493da4 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:40.474568 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048943d-ba66-4237-838a-87a4c8493da4 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:40.474838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048943d-ba66-4237-838a-87a4c8493da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:40.548852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048943d-ba66-4237-838a-87a4c8493da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:40.550295 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048943d-ba66-4237-838a-87a4c8493da4 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:40.576326 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:40.657338 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 131/267] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:40.663106 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0b91a-768f-4180-b4d1-9c327120b5e9 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:40.675127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:40.792484 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0b91a-768f-4180-b4d1-9c327120b5e9 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:40.836710 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65ccf6-45ca-409a-b456-ee3f39dd4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:40.837283 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65ccf6-45ca-409a-b456-ee3f39dd4822 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:40.837551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65ccf6-45ca-409a-b456-ee3f39dd4822 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:40.837813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65ccf6-45ca-409a-b456-ee3f39dd4822 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:40.839084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65ccf6-45ca-409a-b456-ee3f39dd4822 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:40.840553 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65ccf6-45ca-409a-b456-ee3f39dd4822 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:40.842913 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 137/268] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:40 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:40.848861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048943d-ba66-4237-838a-87a4c8493da4 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:40.955323 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048943d-ba66-4237-838a-87a4c8493da4 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:40.979565 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:40.997473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a846c5-b16d-43d5-bb5b-d096da55b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:40.998674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a846c5-b16d-43d5-bb5b-d096da55b891 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:40.999017 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a846c5-b16d-43d5-bb5b-d096da55b891 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:40.999297 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a846c5-b16d-43d5-bb5b-d096da55b891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.000082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a846c5-b16d-43d5-bb5b-d096da55b891 None admin] RBAC: Adding query filter params (role.id=e7e1d965bd9b4d52a96f59ba3965c5ed, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51, user.id=0cd110af900b421e922ea6834d0c9df2) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:41.000388 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a846c5-b16d-43d5-bb5b-d096da55b891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:41.001897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a846c5-b16d-43d5-bb5b-d096da55b891 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:41.008806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 132/269] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:40 2022] GET /identity/v3/role_assignments?user.id=0cd110af900b421e922ea6834d0c9df2&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=e7e1d965bd9b4d52a96f59ba3965c5ed => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:41.165464 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25d85-722a-4e14-9d7c-4a51c87054fe None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:41.165843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25d85-722a-4e14-9d7c-4a51c87054fe None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:41.166010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25d85-722a-4e14-9d7c-4a51c87054fe None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.167630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 138/270] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:41.173257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de59c4-0cb1-4e4c-8d1c-5cad53a43c41 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:41.173558 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de59c4-0cb1-4e4c-8d1c-5cad53a43c41 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:41.173807 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de59c4-0cb1-4e4c-8d1c-5cad53a43c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.195944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-75de59c4-0cb1-4e4c-8d1c-5cad53a43c41 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:41.197207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-75de59c4-0cb1-4e4c-8d1c-5cad53a43c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:41.273700 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 133/271] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:41.410648 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb5acd-5598-4f63-9f42-8a496ce2a867 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:41.410976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb5acd-5598-4f63-9f42-8a496ce2a867 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:41.411216 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb5acd-5598-4f63-9f42-8a496ce2a867 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.412548 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 139/272] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:41.417993 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8ccc-d9f4-40df-8435-57f6fa6f7f57 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:41.418217 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8ccc-d9f4-40df-8435-57f6fa6f7f57 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:41.418488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8ccc-d9f4-40df-8435-57f6fa6f7f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.441456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-8c0d8ccc-d9f4-40df-8435-57f6fa6f7f57 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:41.442736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-8c0d8ccc-d9f4-40df-8435-57f6fa6f7f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:41.516761 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 134/273] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:41.522266 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323426-5659-4025-a517-d0ff82138c2a None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:41.522534 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323426-5659-4025-a517-d0ff82138c2a None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:41.522803 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323426-5659-4025-a517-d0ff82138c2a None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.524263 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 140/274] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:41.529779 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ed93-cc03-4be8-8ae1-e2054233f52c None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:41.530030 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ed93-cc03-4be8-8ae1-e2054233f52c None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:41.530299 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ed93-cc03-4be8-8ae1-e2054233f52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.551554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-3064ed93-cc03-4be8-8ae1-e2054233f52c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:41.552763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-3064ed93-cc03-4be8-8ae1-e2054233f52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:41.601862 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:41.631821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 135/275] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:41.650020 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f323426-5659-4025-a517-d0ff82138c2a None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:41.737321 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:41.762791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f323426-5659-4025-a517-d0ff82138c2a None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:41.797776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11abf9-a154-4938-a72d-3479d10a631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:41.798416 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11abf9-a154-4938-a72d-3479d10a631e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:41.798689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11abf9-a154-4938-a72d-3479d10a631e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:41.798964 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11abf9-a154-4938-a72d-3479d10a631e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.809590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11abf9-a154-4938-a72d-3479d10a631e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-2c11abf9-a154-4938-a72d-3479d10a631e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:41.814809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:41.815957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:41.816753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 141/276] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:41.828112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064ed93-cc03-4be8-8ae1-e2054233f52c None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:41.886561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11abf9-a154-4938-a72d-3479d10a631e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:41.931254 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064ed93-cc03-4be8-8ae1-e2054233f52c None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:41.967293 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:41.968480 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:41.968912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:41.969323 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:41.969979 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:41.970411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:41.971949 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:41.980496 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 136/277] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:41.981531 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:41.990279 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11abf9-a154-4938-a72d-3479d10a631e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.025247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:42.026367 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac1b0d-f1b7-4e69-bd0b-33a5e5e37014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.027019 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1b0d-f1b7-4e69-bd0b-33a5e5e37014 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.027333 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1b0d-f1b7-4e69-bd0b-33a5e5e37014 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.027568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1b0d-f1b7-4e69-bd0b-33a5e5e37014 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.031105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:42.041172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac1b0d-f1b7-4e69-bd0b-33a5e5e37014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-e0ac1b0d-f1b7-4e69-bd0b-33a5e5e37014 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:42.046232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:42.047152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:42.047977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 142/278] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:42.048607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac1b0d-f1b7-4e69-bd0b-33a5e5e37014 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:42.105091 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f6c65-f860-47b5-8a55-33a5b42bc11f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.144935 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3ea38-f550-4609-b0f8-cdbb3c545b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.145677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ea38-f550-4609-b0f8-cdbb3c545b0a None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.145954 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ea38-f550-4609-b0f8-cdbb3c545b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.146333 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3ea38-f550-4609-b0f8-cdbb3c545b0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.147466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3ea38-f550-4609-b0f8-cdbb3c545b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:42.149164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3ea38-f550-4609-b0f8-cdbb3c545b0a None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:42.151205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 137/279] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:42.152093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3ea38-f550-4609-b0f8-cdbb3c545b0a None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:42.159121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac1b0d-f1b7-4e69-bd0b-33a5e5e37014 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.194360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066eb59-b1a7-4c0f-8474-8b1ba0aca5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.195026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066eb59-b1a7-4c0f-8474-8b1ba0aca5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.195298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066eb59-b1a7-4c0f-8474-8b1ba0aca5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.195569 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066eb59-b1a7-4c0f-8474-8b1ba0aca5b5 None admin] PATH_INFO: `/v3/users/9bbd29b41b63495a810a17154a196ee2` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.209519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066eb59-b1a7-4c0f-8474-8b1ba0aca5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=9bbd29b41b63495a810a17154a196ee2)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:42.210989 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066eb59-b1a7-4c0f-8474-8b1ba0aca5b5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:42.212682 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 143/280] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:42 2022] GET /identity/v3/users/9bbd29b41b63495a810a17154a196ee2 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:42.213423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066eb59-b1a7-4c0f-8474-8b1ba0aca5b5 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:42.269317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3ea38-f550-4609-b0f8-cdbb3c545b0a None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.271695 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:42.274646 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:42.310438 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.311086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.311360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.311695 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.312369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:42.312666 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:42.314182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:42.323464 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066eb59-b1a7-4c0f-8474-8b1ba0aca5b5 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.327261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 138/281] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:42.327261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:42.364359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a75b-5a68-4d97-9a5c-d3f0d597b233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.364974 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a75b-5a68-4d97-9a5c-d3f0d597b233 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.365254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a75b-5a68-4d97-9a5c-d3f0d597b233 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.365525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a75b-5a68-4d97-9a5c-d3f0d597b233 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.366165 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789a75b-5a68-4d97-9a5c-d3f0d597b233 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:42.367748 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789a75b-5a68-4d97-9a5c-d3f0d597b233 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:42.392039 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 144/282] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:26:42 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:42.392772 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a75b-5a68-4d97-9a5c-d3f0d597b233 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:42.452542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab481b90-54e5-454f-ac10-e1d88eb8f386 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.498876 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.499956 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.500432 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.501048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.502148 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] RBAC: Adding query filter params (role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, user.id=9bbd29b41b63495a810a17154a196ee2, scope.system=all) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:42.502657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:42.504368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:42.511264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 139/283] 10.222.0.69 () {56 vars in 1308 bytes} [Fri Aug 19 02:26:42 2022] GET /identity/v3/role_assignments?user.id=9bbd29b41b63495a810a17154a196ee2&scope.system=all&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:42.515894 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a75b-5a68-4d97-9a5c-d3f0d597b233 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.529988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:42.563119 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb7343-c8fa-4381-99eb-98e343895b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.564271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb7343-c8fa-4381-99eb-98e343895b9e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.564749 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb7343-c8fa-4381-99eb-98e343895b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.565242 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb7343-c8fa-4381-99eb-98e343895b9e None admin] PATH_INFO: `/v3/users/3c252764ae5b4e0ea9f5dfbfeb4dba4d` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.566843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb7343-c8fa-4381-99eb-98e343895b9e None admin] RBAC: Authorizing `identity:get_user(user_id=3c252764ae5b4e0ea9f5dfbfeb4dba4d)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:42.568743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb7343-c8fa-4381-99eb-98e343895b9e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:42.570758 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 145/284] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:42 2022] GET /identity/v3/users/3c252764ae5b4e0ea9f5dfbfeb4dba4d => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:42.577032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:42.616992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:42.702622 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75816968-001c-4d37-8c4e-849bbbaba950 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.743073 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b63173-0ce5-4d46-84fe-316345f7335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.743729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b63173-0ce5-4d46-84fe-316345f7335d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.744007 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b63173-0ce5-4d46-84fe-316345f7335d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.744280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b63173-0ce5-4d46-84fe-316345f7335d None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.745406 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b63173-0ce5-4d46-84fe-316345f7335d None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:42.746854 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b63173-0ce5-4d46-84fe-316345f7335d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:42.748771 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 140/285] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:42 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:42.754569 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb7343-c8fa-4381-99eb-98e343895b9e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:42.782694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f760bc-0b67-4864-9326-2e12d776eebc None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.782694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f760bc-0b67-4864-9326-2e12d776eebc None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.782924 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f760bc-0b67-4864-9326-2e12d776eebc None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.784476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 141/286] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:42.792579 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee9fb-45c7-45b1-b82c-eec1fb16ff89 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.792932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee9fb-45c7-45b1-b82c-eec1fb16ff89 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.793199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee9fb-45c7-45b1-b82c-eec1fb16ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.812729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-fcbee9fb-45c7-45b1-b82c-eec1fb16ff89 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:42.814041 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-fcbee9fb-45c7-45b1-b82c-eec1fb16ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:42.881729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb7343-c8fa-4381-99eb-98e343895b9e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:42.910690 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 142/287] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:42.924857 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2366f68-fbb4-4b30-9a40-71232689ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:42.925525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366f68-fbb4-4b30-9a40-71232689ed7b None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:42.925801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366f68-fbb4-4b30-9a40-71232689ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:42.926074 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366f68-fbb4-4b30-9a40-71232689ed7b None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/users/3c252764ae5b4e0ea9f5dfbfeb4dba4d/roles/ad59177e2ed34618b4eddfa1ba66c8c5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:42.928150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2366f68-fbb4-4b30-9a40-71232689ed7b None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51, user_id=3c252764ae5b4e0ea9f5dfbfeb4dba4d, role_id=ad59177e2ed34618b4eddfa1ba66c8c5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:42.929650 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2366f68-fbb4-4b30-9a40-71232689ed7b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:42.949932 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 146/288] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:26:42 2022] PUT /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/users/3c252764ae5b4e0ea9f5dfbfeb4dba4d/roles/ad59177e2ed34618b4eddfa1ba66c8c5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:43.274825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbee9fb-45c7-45b1-b82c-eec1fb16ff89 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:43.305163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:43.402916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbee9fb-45c7-45b1-b82c-eec1fb16ff89 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:43.451833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad58e72-e651-43a3-aea1-85af85a462a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:43.452476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad58e72-e651-43a3-aea1-85af85a462a3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:43.452753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad58e72-e651-43a3-aea1-85af85a462a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:43.453017 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad58e72-e651-43a3-aea1-85af85a462a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:43.470273 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad58e72-e651-43a3-aea1-85af85a462a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-aad58e72-e651-43a3-aea1-85af85a462a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:43.475185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:43.476062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:43.476851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 143/289] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:43.483062 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2366f68-fbb4-4b30-9a40-71232689ed7b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:43.569982 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:43.646458 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2366f68-fbb4-4b30-9a40-71232689ed7b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:43.701477 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:43.702105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:43.702380 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:43.702650 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:43.703353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] RBAC: Adding query filter params (name=member) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:43.703661 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:43.705033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:43.714556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 147/290] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:43.721008 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad58e72-e651-43a3-aea1-85af85a462a3 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:43.870204 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:43.889899 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad58e72-e651-43a3-aea1-85af85a462a3 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:43.932415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86673af-89e2-4f30-bc6d-68740f379f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:43.933051 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86673af-89e2-4f30-bc6d-68740f379f61 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:43.933314 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86673af-89e2-4f30-bc6d-68740f379f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:43.933584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86673af-89e2-4f30-bc6d-68740f379f61 None admin] PATH_INFO: `/v3/users/9286b4ead54049c5889381c2fc9a789b` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:43.934767 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86673af-89e2-4f30-bc6d-68740f379f61 None admin] RBAC: Authorizing `identity:get_user(user_id=9286b4ead54049c5889381c2fc9a789b)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:43.936330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86673af-89e2-4f30-bc6d-68740f379f61 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:43.938164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 144/291] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:43 2022] GET /identity/v3/users/9286b4ead54049c5889381c2fc9a789b => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:43.943684 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:44.057475 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c814d-36a4-4423-a0d0-7412e9f2b391 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:44.060907 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:44.109187 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b03130-59bf-44f1-b280-f2a352eb3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:44.109813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03130-59bf-44f1-b280-f2a352eb3606 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:44.110092 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03130-59bf-44f1-b280-f2a352eb3606 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:44.110420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03130-59bf-44f1-b280-f2a352eb3606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:44.192874 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b03130-59bf-44f1-b280-f2a352eb3606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:44.194288 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b03130-59bf-44f1-b280-f2a352eb3606 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:44.290565 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:44.298849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 148/292] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:44.304645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86673af-89e2-4f30-bc6d-68740f379f61 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:44.439726 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86673af-89e2-4f30-bc6d-68740f379f61 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:44.496833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489533fe-aaba-4a15-9405-c7fd41d9e383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:44.497493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489533fe-aaba-4a15-9405-c7fd41d9e383 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:44.497768 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489533fe-aaba-4a15-9405-c7fd41d9e383 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:44.498034 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489533fe-aaba-4a15-9405-c7fd41d9e383 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:44.499172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489533fe-aaba-4a15-9405-c7fd41d9e383 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:44.500615 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489533fe-aaba-4a15-9405-c7fd41d9e383 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:44.502626 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 145/293] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:44 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:44.508204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b03130-59bf-44f1-b280-f2a352eb3606 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:44.658806 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b03130-59bf-44f1-b280-f2a352eb3606 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:44.706603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b8ca0-bf0a-49be-8ce3-153167a782bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:44.707244 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b8ca0-bf0a-49be-8ce3-153167a782bc None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:44.707521 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b8ca0-bf0a-49be-8ce3-153167a782bc None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:44.707790 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b8ca0-bf0a-49be-8ce3-153167a782bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:44.708522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b8ca0-bf0a-49be-8ce3-153167a782bc None admin] RBAC: Adding query filter params (role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51, user.id=9286b4ead54049c5889381c2fc9a789b) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:44.708827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b8ca0-bf0a-49be-8ce3-153167a782bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:44.710292 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b8ca0-bf0a-49be-8ce3-153167a782bc None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:44.720315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 149/294] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:44 2022] GET /identity/v3/role_assignments?user.id=9286b4ead54049c5889381c2fc9a789b&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:45.253272 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bfac4-6942-46be-bf75-62d8aef15904 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.253808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bfac4-6942-46be-bf75-62d8aef15904 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.253808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bfac4-6942-46be-bf75-62d8aef15904 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.255675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 146/295] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:45.261822 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d624a-14e5-4f49-a5cf-0038c8788da5 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.262385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d624a-14e5-4f49-a5cf-0038c8788da5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.262385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d624a-14e5-4f49-a5cf-0038c8788da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.282697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-312d624a-14e5-4f49-a5cf-0038c8788da5 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:45.283950 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-312d624a-14e5-4f49-a5cf-0038c8788da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:45.296469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063cef2-234d-453c-bd65-d7062b6561e7 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.296788 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063cef2-234d-453c-bd65-d7062b6561e7 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.297022 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063cef2-234d-453c-bd65-d7062b6561e7 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.298702 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 147/296] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:45.305193 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980a62-b68c-4e43-8593-bdfae5d017c0 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.305472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980a62-b68c-4e43-8593-bdfae5d017c0 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.305743 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980a62-b68c-4e43-8593-bdfae5d017c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.333629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-0b980a62-b68c-4e43-8593-bdfae5d017c0 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:45.334842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-0b980a62-b68c-4e43-8593-bdfae5d017c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:45.361016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:45.365449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:45.381638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 150/297] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:45.426939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 148/298] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:45.432510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c05fe-d3ea-4e3c-99fc-05aaba69fba2 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.432789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c05fe-d3ea-4e3c-99fc-05aaba69fba2 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.433054 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c05fe-d3ea-4e3c-99fc-05aaba69fba2 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.434503 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 151/299] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:45.440163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547e5f2-90dd-4ecf-a66d-e1a2bc03a7f6 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.440678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547e5f2-90dd-4ecf-a66d-e1a2bc03a7f6 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.441122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547e5f2-90dd-4ecf-a66d-e1a2bc03a7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.460463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-a547e5f2-90dd-4ecf-a66d-e1a2bc03a7f6 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:45.461918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-a547e5f2-90dd-4ecf-a66d-e1a2bc03a7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:45.539895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 149/300] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:26:45.728851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c05fe-d3ea-4e3c-99fc-05aaba69fba2 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:45.763140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547e5f2-90dd-4ecf-a66d-e1a2bc03a7f6 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:45.853312 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:45.853603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c05fe-d3ea-4e3c-99fc-05aaba69fba2 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:45.870819 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547e5f2-90dd-4ecf-a66d-e1a2bc03a7f6 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:45.887905 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d6b74-850a-4067-9fe2-cb9259bb85f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:45.888654 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d6b74-850a-4067-9fe2-cb9259bb85f9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.888921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d6b74-850a-4067-9fe2-cb9259bb85f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.889185 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d6b74-850a-4067-9fe2-cb9259bb85f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.899078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d6b74-850a-4067-9fe2-cb9259bb85f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-ea2d6b74-850a-4067-9fe2-cb9259bb85f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:45.903714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:45.904778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:45.905763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:45.906534 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d0f6-303e-4044-a234-43d8cc44f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:45.906534 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d0f6-303e-4044-a234-43d8cc44f85c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.906534 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d0f6-303e-4044-a234-43d8cc44f85c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.906734 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 152/301] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:45.906806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d0f6-303e-4044-a234-43d8cc44f85c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.906872 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a84b-4811-4195-bbcd-4f4fa9b5ef50 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:45.906872 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a84b-4811-4195-bbcd-4f4fa9b5ef50 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:45.906872 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a84b-4811-4195-bbcd-4f4fa9b5ef50 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:45.908116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 153/302] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:45.911904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a84b-4811-4195-bbcd-4f4fa9b5ef50 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:45.919496 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796d0f6-303e-4044-a234-43d8cc44f85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-8796d0f6-303e-4044-a234-43d8cc44f85c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:45.924247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:45.925290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:45.926104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 150/303] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:45.926754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d0f6-303e-4044-a234-43d8cc44f85c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:45.971977 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:46.016992 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a84b-4811-4195-bbcd-4f4fa9b5ef50 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.027405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d0f6-303e-4044-a234-43d8cc44f85c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.051258 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e849-aea9-4d36-8495-8c98c35503ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.051890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e849-aea9-4d36-8495-8c98c35503ae None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.052165 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e849-aea9-4d36-8495-8c98c35503ae None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.052438 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e849-aea9-4d36-8495-8c98c35503ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.053522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49e849-aea9-4d36-8495-8c98c35503ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.055017 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49e849-aea9-4d36-8495-8c98c35503ae None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.056591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 154/304] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:46.057739 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a95a2-3100-4071-a1d8-6cf1da23478e None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.058048 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a95a2-3100-4071-a1d8-6cf1da23478e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.058264 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a95a2-3100-4071-a1d8-6cf1da23478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.062253 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.062853 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.063858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.063858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.064054 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:46.064355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.065751 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.075503 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 151/305] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:46.076149 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.085037 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-dc2a95a2-3100-4071-a1d8-6cf1da23478e None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:46.085556 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:46.086236 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-dc2a95a2-3100-4071-a1d8-6cf1da23478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:46.151537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 155/306] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:46.152360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a95a2-3100-4071-a1d8-6cf1da23478e None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.175455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c821dc8-471a-4453-a130-a5b36c966c4c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.208481 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:46.216030 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.216656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.216935 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.217208 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.218241 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:46.218549 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.219951 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.228286 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 152/307] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:46.228994 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.260867 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a95a2-3100-4071-a1d8-6cf1da23478e None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.296315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed095921-362d-4472-8c65-a714a8e581eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.296937 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed095921-362d-4472-8c65-a714a8e581eb None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.297189 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed095921-362d-4472-8c65-a714a8e581eb None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.297470 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed095921-362d-4472-8c65-a714a8e581eb None admin] PATH_INFO: `/v3/groups` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.298079 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed095921-362d-4472-8c65-a714a8e581eb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.299556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed095921-362d-4472-8c65-a714a8e581eb None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.302322 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:46.317827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 156/308] 10.222.0.69 () {60 vars in 1134 bytes} [Fri Aug 19 02:26:46 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:46.318663 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed095921-362d-4472-8c65-a714a8e581eb None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.356705 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721e8a2-5f22-4e67-ad72-639469a064ac None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.398417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b474a-b79b-4ea4-a1b6-c1ba14fc3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.399057 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b474a-b79b-4ea4-a1b6-c1ba14fc3ddd None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.399304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b474a-b79b-4ea4-a1b6-c1ba14fc3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.399577 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b474a-b79b-4ea4-a1b6-c1ba14fc3ddd None admin] PATH_INFO: `/v3/users/90f157b811434ecb97b8cc89db80d63c` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.415142 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b474a-b79b-4ea4-a1b6-c1ba14fc3ddd None admin] RBAC: Authorizing `identity:get_user(user_id=90f157b811434ecb97b8cc89db80d63c)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.416597 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b474a-b79b-4ea4-a1b6-c1ba14fc3ddd None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.419145 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 153/309] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:46 2022] GET /identity/v3/users/90f157b811434ecb97b8cc89db80d63c => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:46.428422 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b474a-b79b-4ea4-a1b6-c1ba14fc3ddd None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.460027 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed095921-362d-4472-8c65-a714a8e581eb None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.480793 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:46.508002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e0e57-ac6a-4b13-b37e-15359af7b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.508750 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e0e57-ac6a-4b13-b37e-15359af7b677 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.509023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e0e57-ac6a-4b13-b37e-15359af7b677 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.509293 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e0e57-ac6a-4b13-b37e-15359af7b677 None admin] PATH_INFO: `/v3/users/9bbd29b41b63495a810a17154a196ee2` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.510572 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e0e57-ac6a-4b13-b37e-15359af7b677 None admin] RBAC: Authorizing `identity:get_user(user_id=9bbd29b41b63495a810a17154a196ee2)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.513129 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e0e57-ac6a-4b13-b37e-15359af7b677 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.513944 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 157/310] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:46 2022] GET /identity/v3/users/9bbd29b41b63495a810a17154a196ee2 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:46.514912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e0e57-ac6a-4b13-b37e-15359af7b677 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.569742 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b474a-b79b-4ea4-a1b6-c1ba14fc3ddd None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.598583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:46.609322 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.610026 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.610308 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.610689 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.611539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] RBAC: Adding query filter params (role.id=ad59177e2ed34618b4eddfa1ba66c8c5, user.id=90f157b811434ecb97b8cc89db80d63c, scope.system=all) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:46.611913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.613473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.618718 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 154/311] 10.222.0.69 () {56 vars in 1308 bytes} [Fri Aug 19 02:26:46 2022] GET /identity/v3/role_assignments?user.id=90f157b811434ecb97b8cc89db80d63c&scope.system=all&role.id=ad59177e2ed34618b4eddfa1ba66c8c5 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:46.619989 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.631842 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e0e57-ac6a-4b13-b37e-15359af7b677 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.672859 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71e93-a088-4848-af5d-b5ce0126f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.673849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71e93-a088-4848-af5d-b5ce0126f538 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.674254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71e93-a088-4848-af5d-b5ce0126f538 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.674747 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f71e93-a088-4848-af5d-b5ce0126f538 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.687857 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f71e93-a088-4848-af5d-b5ce0126f538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-68f71e93-a088-4848-af5d-b5ce0126f538 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:46.693960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:46.694919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:46.696061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:46.698603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 158/312] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:46.704803 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71e93-a088-4848-af5d-b5ce0126f538 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.754541 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:46.772255 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507dd2e-de99-42f4-8871-fed803cb3c34 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.825997 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b8e68-5a08-416d-85f5-5c8d2deb282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.826676 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b8e68-5a08-416d-85f5-5c8d2deb282b None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.827023 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b8e68-5a08-416d-85f5-5c8d2deb282b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.827294 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b8e68-5a08-416d-85f5-5c8d2deb282b None admin] PATH_INFO: `/v3/system/users/9bbd29b41b63495a810a17154a196ee2/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.829685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b8e68-5a08-416d-85f5-5c8d2deb282b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9bbd29b41b63495a810a17154a196ee2, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.831468 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b8e68-5a08-416d-85f5-5c8d2deb282b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.835171 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f71e93-a088-4848-af5d-b5ce0126f538 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:46.845796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 155/313] 10.222.0.69 () {58 vars in 1334 bytes} [Fri Aug 19 02:26:46 2022] PUT /identity/v3/system/users/9bbd29b41b63495a810a17154a196ee2/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:46.883535 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:46.884172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:46.884449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:46.884719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:46.885402 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:46.885705 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:46.887145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:46.897487 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 159/314] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:46.903272 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b8e68-5a08-416d-85f5-5c8d2deb282b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:46.966872 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:47.016864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b8e68-5a08-416d-85f5-5c8d2deb282b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:47.056516 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a7942-f4a5-4974-8ee5-07071fae048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:47.057472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a7942-f4a5-4974-8ee5-07071fae048c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:47.057746 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a7942-f4a5-4974-8ee5-07071fae048c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:47.058013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a7942-f4a5-4974-8ee5-07071fae048c None admin] PATH_INFO: `/v3/users/3c252764ae5b4e0ea9f5dfbfeb4dba4d` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:47.059180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a7942-f4a5-4974-8ee5-07071fae048c None admin] RBAC: Authorizing `identity:get_user(user_id=3c252764ae5b4e0ea9f5dfbfeb4dba4d)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:47.060674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a7942-f4a5-4974-8ee5-07071fae048c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:47.062491 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 156/315] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:46 2022] GET /identity/v3/users/3c252764ae5b4e0ea9f5dfbfeb4dba4d => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:47.067926 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:47.179918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da3f4-f1f1-4220-a23b-e3338fef3b2f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:47.181789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:47.217253 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f24c00-a111-4c1b-aaa6-accc4eee79e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:47.218164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f24c00-a111-4c1b-aaa6-accc4eee79e1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:47.218445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f24c00-a111-4c1b-aaa6-accc4eee79e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:47.218714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f24c00-a111-4c1b-aaa6-accc4eee79e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:47.292551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f24c00-a111-4c1b-aaa6-accc4eee79e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:47.294481 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f24c00-a111-4c1b-aaa6-accc4eee79e1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:47.399422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 160/316] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:47.408280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a7942-f4a5-4974-8ee5-07071fae048c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:47.518529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a7942-f4a5-4974-8ee5-07071fae048c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:47.542024 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:47.555337 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169ae79-a164-4686-b145-ed2f12a2f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:47.555983 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ae79-a164-4686-b145-ed2f12a2f949 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:47.556258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ae79-a164-4686-b145-ed2f12a2f949 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:47.556528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169ae79-a164-4686-b145-ed2f12a2f949 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:47.557647 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169ae79-a164-4686-b145-ed2f12a2f949 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:47.559123 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169ae79-a164-4686-b145-ed2f12a2f949 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:47.561145 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 157/317] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:47 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:47.568112 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f24c00-a111-4c1b-aaa6-accc4eee79e1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:47.570518 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:47.683863 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f24c00-a111-4c1b-aaa6-accc4eee79e1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:47.720692 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca6ccc-344e-48f1-b823-d1e324958006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:47.721643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6ccc-344e-48f1-b823-d1e324958006 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:47.722125 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6ccc-344e-48f1-b823-d1e324958006 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:47.722741 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6ccc-344e-48f1-b823-d1e324958006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:47.723733 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca6ccc-344e-48f1-b823-d1e324958006 None admin] RBAC: Adding query filter params (role.id=ad59177e2ed34618b4eddfa1ba66c8c5, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51, user.id=3c252764ae5b4e0ea9f5dfbfeb4dba4d) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:47.724235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca6ccc-344e-48f1-b823-d1e324958006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:47.725879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca6ccc-344e-48f1-b823-d1e324958006 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:47.732580 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 161/318] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:26:47 2022] GET /identity/v3/role_assignments?user.id=3c252764ae5b4e0ea9f5dfbfeb4dba4d&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=ad59177e2ed34618b4eddfa1ba66c8c5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:48.569496 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587abe0-32c5-419e-b64f-84ecba1f8a44 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:48.570312 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587abe0-32c5-419e-b64f-84ecba1f8a44 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:48.570312 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587abe0-32c5-419e-b64f-84ecba1f8a44 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:48.571524 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 158/319] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:48.576822 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99237b4-04e6-4a15-83f2-04596dd015f5 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:48.577241 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99237b4-04e6-4a15-83f2-04596dd015f5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:48.577403 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99237b4-04e6-4a15-83f2-04596dd015f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:48.596412 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-b99237b4-04e6-4a15-83f2-04596dd015f5 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:48.597805 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-b99237b4-04e6-4a15-83f2-04596dd015f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:48.659849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:48.669136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 162/320] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:48.922767 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc93bb8-8efe-442b-9a22-3c2ca5204037 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:48.923225 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc93bb8-8efe-442b-9a22-3c2ca5204037 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:48.923330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc93bb8-8efe-442b-9a22-3c2ca5204037 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:48.924646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 159/321] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:48.930260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7de38f-0c9c-4426-b2d9-8433a2793229 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:48.930550 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7de38f-0c9c-4426-b2d9-8433a2793229 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:48.930821 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7de38f-0c9c-4426-b2d9-8433a2793229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:48.949601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-bc7de38f-0c9c-4426-b2d9-8433a2793229 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:48.950810 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-bc7de38f-0c9c-4426-b2d9-8433a2793229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:48.988774 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc93bb8-8efe-442b-9a22-3c2ca5204037 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:49.026780 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 163/322] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:49.107673 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc93bb8-8efe-442b-9a22-3c2ca5204037 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:49.144204 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae11fb-44f6-4650-b7ae-99b34bed1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:49.145072 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae11fb-44f6-4650-b7ae-99b34bed1272 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:49.145352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae11fb-44f6-4650-b7ae-99b34bed1272 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:49.145621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae11fb-44f6-4650-b7ae-99b34bed1272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:49.146721 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae11fb-44f6-4650-b7ae-99b34bed1272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:49.148210 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae11fb-44f6-4650-b7ae-99b34bed1272 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:49.151046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 160/323] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:26:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:49.155571 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7de38f-0c9c-4426-b2d9-8433a2793229 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:49.168762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721fd54-b3f3-4c96-8d0e-41f50f25d87c None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:49.169122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721fd54-b3f3-4c96-8d0e-41f50f25d87c None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:49.169355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721fd54-b3f3-4c96-8d0e-41f50f25d87c None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:49.170680 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 161/324] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:49.175671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16a70-5b0a-494b-8f50-2f414c139c90 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:49.175781 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16a70-5b0a-494b-8f50-2f414c139c90 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:49.176060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16a70-5b0a-494b-8f50-2f414c139c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:49.194736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-e4b16a70-5b0a-494b-8f50-2f414c139c90 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:49.195963 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-e4b16a70-5b0a-494b-8f50-2f414c139c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:49.253791 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:49.266183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7de38f-0c9c-4426-b2d9-8433a2793229 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:49.268369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 162/325] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:49.292691 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:49.302008 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cbd5e-33b2-4730-8bb5-e6261a0dcbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:49.302621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbd5e-33b2-4730-8bb5-e6261a0dcbe4 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:49.302896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbd5e-33b2-4730-8bb5-e6261a0dcbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:49.303232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbd5e-33b2-4730-8bb5-e6261a0dcbe4 None admin] PATH_INFO: `/v3/groups` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:49.303868 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cbd5e-33b2-4730-8bb5-e6261a0dcbe4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:49.305363 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cbd5e-33b2-4730-8bb5-e6261a0dcbe4 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:49.331030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 164/326] 10.222.0.69 () {60 vars in 1134 bytes} [Fri Aug 19 02:26:49 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:26:49.348120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b16a70-5b0a-494b-8f50-2f414c139c90 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:49.460079 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b16a70-5b0a-494b-8f50-2f414c139c90 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:49.497080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d5857-4659-44fb-826d-4900e99e65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:49.497802 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5857-4659-44fb-826d-4900e99e65d2 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:49.498077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5857-4659-44fb-826d-4900e99e65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:49.498338 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5857-4659-44fb-826d-4900e99e65d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:49.510930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d5857-4659-44fb-826d-4900e99e65d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-de8d5857-4659-44fb-826d-4900e99e65d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:49.515313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:49.516195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:49.517588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 163/327] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:49.522966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cbd5e-33b2-4730-8bb5-e6261a0dcbe4 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:49.615588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d5857-4659-44fb-826d-4900e99e65d2 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:49.655274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cbd5e-33b2-4730-8bb5-e6261a0dcbe4 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:49.689672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:49.694415 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:49.695060 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:49.695338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:49.695604 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:49.696305 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:49.696569 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:49.697956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:49.707715 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 165/328] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:49.713488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:49.766080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d5857-4659-44fb-826d-4900e99e65d2 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:49.777015 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:49.821195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0c51f-d6c4-46e2-a4a8-a565b0cf92f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:49.822448 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c51f-d6c4-46e2-a4a8-a565b0cf92f8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:49.822913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c51f-d6c4-46e2-a4a8-a565b0cf92f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:49.823600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c51f-d6c4-46e2-a4a8-a565b0cf92f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:49.838700 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0c51f-d6c4-46e2-a4a8-a565b0cf92f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:49.841882 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee415b-954f-4b84-b64e-f7923aab5ce1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-04e0c51f-d6c4-46e2-a4a8-a565b0cf92f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:49.846325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:49.847283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:49.848108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:49.848711 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 164/329] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:49.854659 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0c51f-d6c4-46e2-a4a8-a565b0cf92f8 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:49.895029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949737d1-049b-4392-a31e-280ed82f8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:49.895029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949737d1-049b-4392-a31e-280ed82f8727 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:49.895390 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949737d1-049b-4392-a31e-280ed82f8727 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:49.895598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949737d1-049b-4392-a31e-280ed82f8727 None admin] PATH_INFO: `/v3/users/90f157b811434ecb97b8cc89db80d63c` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:49.897448 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949737d1-049b-4392-a31e-280ed82f8727 None admin] RBAC: Authorizing `identity:get_user(user_id=90f157b811434ecb97b8cc89db80d63c)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:49.899133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949737d1-049b-4392-a31e-280ed82f8727 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:49.901577 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 166/330] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:49 2022] GET /identity/v3/users/90f157b811434ecb97b8cc89db80d63c => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:49.908019 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949737d1-049b-4392-a31e-280ed82f8727 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:49.973769 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0c51f-d6c4-46e2-a4a8-a565b0cf92f8 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:49.983917 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:50.013767 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:50.014463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:50.014799 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:50.015173 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:50.015901 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:50.016261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:50.017722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:50.027637 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 165/331] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:50.033415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:50.042904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949737d1-049b-4392-a31e-280ed82f8727 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:50.065029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:50.091701 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64b57-29f0-4b9a-81b0-3ee0e01659e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:50.093070 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64b57-29f0-4b9a-81b0-3ee0e01659e2 None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:50.093515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64b57-29f0-4b9a-81b0-3ee0e01659e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:50.094171 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64b57-29f0-4b9a-81b0-3ee0e01659e2 None admin] PATH_INFO: `/v3/system/users/90f157b811434ecb97b8cc89db80d63c/roles/ad59177e2ed34618b4eddfa1ba66c8c5` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:50.096471 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64b57-29f0-4b9a-81b0-3ee0e01659e2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=90f157b811434ecb97b8cc89db80d63c, role_id=ad59177e2ed34618b4eddfa1ba66c8c5)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:50.098258 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64b57-29f0-4b9a-81b0-3ee0e01659e2 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:50.111551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 167/332] 10.222.0.69 () {58 vars in 1334 bytes} [Fri Aug 19 02:26:49 2022] PUT /identity/v3/system/users/90f157b811434ecb97b8cc89db80d63c/roles/ad59177e2ed34618b4eddfa1ba66c8c5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:26:50.158829 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc16f98-abce-44de-b431-c7002002ed8c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:50.199678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182bcee-b0a3-44ec-a757-c1953ec091de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:50.200458 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bcee-b0a3-44ec-a757-c1953ec091de None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:50.200741 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bcee-b0a3-44ec-a757-c1953ec091de None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:50.201165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bcee-b0a3-44ec-a757-c1953ec091de None admin] PATH_INFO: `/v3/users/9bbd29b41b63495a810a17154a196ee2` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:50.202456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182bcee-b0a3-44ec-a757-c1953ec091de None admin] RBAC: Authorizing `identity:get_user(user_id=9bbd29b41b63495a810a17154a196ee2)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:50.204257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182bcee-b0a3-44ec-a757-c1953ec091de None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:50.206255 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 166/333] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:50 2022] GET /identity/v3/users/9bbd29b41b63495a810a17154a196ee2 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:50.213079 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64b57-29f0-4b9a-81b0-3ee0e01659e2 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:50.346244 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64b57-29f0-4b9a-81b0-3ee0e01659e2 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:50.389398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfd35f-f20a-4b71-9246-bb9792766701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:50.390016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd35f-f20a-4b71-9246-bb9792766701 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:50.390324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd35f-f20a-4b71-9246-bb9792766701 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:50.390635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd35f-f20a-4b71-9246-bb9792766701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:50.391384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfd35f-f20a-4b71-9246-bb9792766701 None admin] RBAC: Adding query filter params (role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, user.id=9bbd29b41b63495a810a17154a196ee2, scope.system=all) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:50.391686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfd35f-f20a-4b71-9246-bb9792766701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:50.393185 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfd35f-f20a-4b71-9246-bb9792766701 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:50.406290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 168/334] 10.222.0.69 () {56 vars in 1308 bytes} [Fri Aug 19 02:26:50 2022] GET /identity/v3/role_assignments?user.id=9bbd29b41b63495a810a17154a196ee2&scope.system=all&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:52.043640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a99656-0366-47aa-8bf6-cf029dc0a474 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:52.044163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a99656-0366-47aa-8bf6-cf029dc0a474 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:52.044163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a99656-0366-47aa-8bf6-cf029dc0a474 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:52.045745 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 167/335] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:52.051148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a448dc-c3f1-4178-9086-a52b943e23e6 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:52.051629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a448dc-c3f1-4178-9086-a52b943e23e6 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:52.051705 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a448dc-c3f1-4178-9086-a52b943e23e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:52.073736 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-09a448dc-c3f1-4178-9086-a52b943e23e6 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:52.074935 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-09a448dc-c3f1-4178-9086-a52b943e23e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:52.108147 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:52.155978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 169/336] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:52.347638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758a1c3-fb74-45eb-b126-f96e14a62e0c None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:52.347858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758a1c3-fb74-45eb-b126-f96e14a62e0c None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:52.348168 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758a1c3-fb74-45eb-b126-f96e14a62e0c None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:52.349639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 168/337] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:52.356192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3c22c-9fa9-45ba-9969-68dce90d139f None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:52.356468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3c22c-9fa9-45ba-9969-68dce90d139f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:52.356872 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3c22c-9fa9-45ba-9969-68dce90d139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:52.381071 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-09e3c22c-9fa9-45ba-9969-68dce90d139f None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:52.382254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-09e3c22c-9fa9-45ba-9969-68dce90d139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:52.469768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 170/338] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:52.750751 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758a1c3-fb74-45eb-b126-f96e14a62e0c None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:52.805173 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:52.881433 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758a1c3-fb74-45eb-b126-f96e14a62e0c None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:52.925255 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e658-724f-4226-a2aa-436c7e1dd1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:52.926012 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e658-724f-4226-a2aa-436c7e1dd1fb None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:52.926293 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e658-724f-4226-a2aa-436c7e1dd1fb None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:52.926565 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e658-724f-4226-a2aa-436c7e1dd1fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:52.941180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7e658-724f-4226-a2aa-436c7e1dd1fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-fcc7e658-724f-4226-a2aa-436c7e1dd1fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:52.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:52.947869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:52.948670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 169/339] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:52.954526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3c22c-9fa9-45ba-9969-68dce90d139f None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:53.032658 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e658-724f-4226-a2aa-436c7e1dd1fb None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:53.155472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e658-724f-4226-a2aa-436c7e1dd1fb None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:53.159990 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:53.160526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:53.170546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3c22c-9fa9-45ba-9969-68dce90d139f None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:53.210102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b1f0b-0944-4559-93c4-8c281b6c0014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:53.211171 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b1f0b-0944-4559-93c4-8c281b6c0014 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.211699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b1f0b-0944-4559-93c4-8c281b6c0014 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.212362 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b1f0b-0944-4559-93c4-8c281b6c0014 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.239740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b1f0b-0944-4559-93c4-8c281b6c0014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:53.239938 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652905-0206-4ecf-85ac-5e90303770ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:53.240444 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652905-0206-4ecf-85ac-5e90303770ca None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.240724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652905-0206-4ecf-85ac-5e90303770ca None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.240994 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652905-0206-4ecf-85ac-5e90303770ca None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.241681 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c652905-0206-4ecf-85ac-5e90303770ca None admin] RBAC: Adding query filter params (name=member) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:53.241986 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c652905-0206-4ecf-85ac-5e90303770ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:53.243456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c652905-0206-4ecf-85ac-5e90303770ca None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-730b1f0b-0944-4559-93c4-8c281b6c0014 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:53.246629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:53.247617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:53.248393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:53.251164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 170/340] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:53.253146 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 171/341] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:53.259351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b1f0b-0944-4559-93c4-8c281b6c0014 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:53.262420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417f515-9536-4e26-a865-a385e8eb04bf None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.262701 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417f515-9536-4e26-a865-a385e8eb04bf None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.263074 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417f515-9536-4e26-a865-a385e8eb04bf None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.264396 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 172/342] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:53.269432 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a7c97-88f8-4ac1-9735-bd50da0f787d None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.269714 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a7c97-88f8-4ac1-9735-bd50da0f787d None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.269980 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a7c97-88f8-4ac1-9735-bd50da0f787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.300080 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-5a9a7c97-88f8-4ac1-9735-bd50da0f787d None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:53.301192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-5a9a7c97-88f8-4ac1-9735-bd50da0f787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:53.381467 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b1f0b-0944-4559-93c4-8c281b6c0014 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:53.405709 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 173/343] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:53.406591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a7c97-88f8-4ac1-9735-bd50da0f787d None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:53.427747 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fec3ea-983b-49c2-b2ce-b27d33a86471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:53.428376 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fec3ea-983b-49c2-b2ce-b27d33a86471 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.428674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fec3ea-983b-49c2-b2ce-b27d33a86471 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.428920 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fec3ea-983b-49c2-b2ce-b27d33a86471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.518346 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:53.525765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:53.530383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a7c97-88f8-4ac1-9735-bd50da0f787d None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:53.567737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fec3ea-983b-49c2-b2ce-b27d33a86471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:53.569133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fec3ea-983b-49c2-b2ce-b27d33a86471 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:53.592280 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9fba3-55b1-4b7e-960e-c3a3f9ecd21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:53.593303 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fba3-55b1-4b7e-960e-c3a3f9ecd21e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.593573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fba3-55b1-4b7e-960e-c3a3f9ecd21e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.593832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fba3-55b1-4b7e-960e-c3a3f9ecd21e None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.594489 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9fba3-55b1-4b7e-960e-c3a3f9ecd21e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:53.594781 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9fba3-55b1-4b7e-960e-c3a3f9ecd21e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:53.597386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9fba3-55b1-4b7e-960e-c3a3f9ecd21e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:53.606052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 174/344] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:53.611700 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e124e-dcb3-40c6-a2fa-a3655a657203 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.611986 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e124e-dcb3-40c6-a2fa-a3655a657203 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.612257 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e124e-dcb3-40c6-a2fa-a3655a657203 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.614170 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 175/345] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:53.617922 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e124e-dcb3-40c6-a2fa-a3655a657203 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:53.730295 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e124e-dcb3-40c6-a2fa-a3655a657203 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:53.768274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100599e-22ff-4d34-b0d0-a69615ddd1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:53.768274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100599e-22ff-4d34-b0d0-a69615ddd1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.768274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100599e-22ff-4d34-b0d0-a69615ddd1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.768274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100599e-22ff-4d34-b0d0-a69615ddd1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.773902 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 171/346] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:53.782654 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394d4a-9474-4b26-84fc-a66ef2873689 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:53.783299 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394d4a-9474-4b26-84fc-a66ef2873689 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:53.783895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394d4a-9474-4b26-84fc-a66ef2873689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:53.796896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:53.812747 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-be394d4a-9474-4b26-84fc-a66ef2873689 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:53.814308 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-be394d4a-9474-4b26-84fc-a66ef2873689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:53.850360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100599e-22ff-4d34-b0d0-a69615ddd1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:53.851776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100599e-22ff-4d34-b0d0-a69615ddd1d5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:53.899189 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:53.923161 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 172/347] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:53.924396 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be394d4a-9474-4b26-84fc-a66ef2873689 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:53.963210 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 176/348] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:53.964674 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100599e-22ff-4d34-b0d0-a69615ddd1d5 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.020507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:54.073456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100599e-22ff-4d34-b0d0-a69615ddd1d5 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.085463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be394d4a-9474-4b26-84fc-a66ef2873689 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.111023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e052f-2577-43be-8aeb-274b87a6027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.111675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e052f-2577-43be-8aeb-274b87a6027e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.111944 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e052f-2577-43be-8aeb-274b87a6027e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.112207 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e052f-2577-43be-8aeb-274b87a6027e None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.113331 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e052f-2577-43be-8aeb-274b87a6027e None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:54.114854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e052f-2577-43be-8aeb-274b87a6027e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:54.117441 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 177/349] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:53 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:54.122641 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29775e-2a85-4b0f-b51f-5146e7496c0b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.122965 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29775e-2a85-4b0f-b51f-5146e7496c0b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.123240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29775e-2a85-4b0f-b51f-5146e7496c0b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.125205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 178/350] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:54.126036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29775e-2a85-4b0f-b51f-5146e7496c0b None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.127497 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131e27a-903e-4526-bf2e-5eb9ffa223be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.128385 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131e27a-903e-4526-bf2e-5eb9ffa223be None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.128866 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131e27a-903e-4526-bf2e-5eb9ffa223be None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.133990 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131e27a-903e-4526-bf2e-5eb9ffa223be None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.135644 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131e27a-903e-4526-bf2e-5eb9ffa223be None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:54.137339 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131e27a-903e-4526-bf2e-5eb9ffa223be None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:54.139708 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 173/351] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:53 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:54.140816 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131e27a-903e-4526-bf2e-5eb9ffa223be None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.211940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:54.243365 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29775e-2a85-4b0f-b51f-5146e7496c0b None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.265579 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:54.268089 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131e27a-903e-4526-bf2e-5eb9ffa223be None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.283723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf1519-2ce9-4b4d-a3a1-e61462bfc433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.284352 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1519-2ce9-4b4d-a3a1-e61462bfc433 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.284821 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1519-2ce9-4b4d-a3a1-e61462bfc433 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.285123 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1519-2ce9-4b4d-a3a1-e61462bfc433 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.297219 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf1519-2ce9-4b4d-a3a1-e61462bfc433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-cdaf1519-2ce9-4b4d-a3a1-e61462bfc433 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:54.302225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:54.303202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:54.304056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 179/352] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:54.304777 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc13e9-b34d-4321-ab2f-9eb87cc208f3 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.305609 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc13e9-b34d-4321-ab2f-9eb87cc208f3 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.305609 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc13e9-b34d-4321-ab2f-9eb87cc208f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.312480 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13835ff2-4c19-4441-9256-0fd531d7d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.313492 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13835ff2-4c19-4441-9256-0fd531d7d54f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.314026 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13835ff2-4c19-4441-9256-0fd531d7d54f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.315252 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13835ff2-4c19-4441-9256-0fd531d7d54f None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.322851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13835ff2-4c19-4441-9256-0fd531d7d54f None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:54.325204 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13835ff2-4c19-4441-9256-0fd531d7d54f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:54.328235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-dacc13e9-b34d-4321-ab2f-9eb87cc208f3 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:54.328526 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 174/353] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:54.329499 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13835ff2-4c19-4441-9256-0fd531d7d54f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.331631 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-dacc13e9-b34d-4321-ab2f-9eb87cc208f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:54.412765 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 180/354] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:54.413377 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc13e9-b34d-4321-ab2f-9eb87cc208f3 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.473597 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13835ff2-4c19-4441-9256-0fd531d7d54f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.496787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:54.512053 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e95d-2e72-4167-9c44-8b069e1aaefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.512688 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e95d-2e72-4167-9c44-8b069e1aaefc None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.513001 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e95d-2e72-4167-9c44-8b069e1aaefc None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.513266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e95d-2e72-4167-9c44-8b069e1aaefc None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.514719 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543e95d-2e72-4167-9c44-8b069e1aaefc None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:54.517267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543e95d-2e72-4167-9c44-8b069e1aaefc None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:54.518972 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 175/355] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:54.519906 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e95d-2e72-4167-9c44-8b069e1aaefc None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.534793 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc13e9-b34d-4321-ab2f-9eb87cc208f3 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.546624 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:54.573273 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.574237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.574773 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.575400 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.576256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:54.576835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:54.578411 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:54.591645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 181/356] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:54.593302 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.641003 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e95d-2e72-4167-9c44-8b069e1aaefc None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.678261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.679292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.679759 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.680237 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.681156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] RBAC: Adding query filter params (group.id=9635382eee7942498e692114b1a26658, role.id=e7e1d965bd9b4d52a96f59ba3965c5ed, scope.project.id=66d19a41099445d1876e9c42ba23261f) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:54.681660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:54.683301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:54.692854 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 176/357] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/role_assignments?group.id=9635382eee7942498e692114b1a26658&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=e7e1d965bd9b4d52a96f59ba3965c5ed => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:54.694175 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.750915 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859ce61-ca2a-4e9c-9763-5e0b0fd1a8ea None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.804731 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:54.812506 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fed69-1ae9-4c37-b10b-549baaf3d937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.813557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fed69-1ae9-4c37-b10b-549baaf3d937 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.813980 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fed69-1ae9-4c37-b10b-549baaf3d937 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.814394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fed69-1ae9-4c37-b10b-549baaf3d937 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.831893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fed69-1ae9-4c37-b10b-549baaf3d937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-681fed69-1ae9-4c37-b10b-549baaf3d937 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:54.837818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:54.838956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:54.839795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:54.842199 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 182/358] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:54.843700 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fed69-1ae9-4c37-b10b-549baaf3d937 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.871881 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c446ba0-2707-4e59-b1f1-563dcf2e0bfe None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:54.887297 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:54.922920 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:54.923655 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:54.923932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:54.924200 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:54.925240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] RBAC: Adding query filter params (group.id=9635382eee7942498e692114b1a26658, role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=66d19a41099445d1876e9c42ba23261f) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:54.925555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:54.928006 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:54.937964 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 177/359] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/role_assignments?group.id=9635382eee7942498e692114b1a26658&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:54.939218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:54.985465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fed69-1ae9-4c37-b10b-549baaf3d937 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:55.030509 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67cdc6-b556-4d22-825b-cf1597a0dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:55.031195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67cdc6-b556-4d22-825b-cf1597a0dc5c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.031470 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67cdc6-b556-4d22-825b-cf1597a0dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.031739 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67cdc6-b556-4d22-825b-cf1597a0dc5c None admin] PATH_INFO: `/v3/users/90f157b811434ecb97b8cc89db80d63c` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.032898 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67cdc6-b556-4d22-825b-cf1597a0dc5c None admin] RBAC: Authorizing `identity:get_user(user_id=90f157b811434ecb97b8cc89db80d63c)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:55.034384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67cdc6-b556-4d22-825b-cf1597a0dc5c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:55.036214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 183/360] 10.222.0.69 () {56 vars in 1177 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/users/90f157b811434ecb97b8cc89db80d63c => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:55.037004 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67cdc6-b556-4d22-825b-cf1597a0dc5c None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:55.064739 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e8afc-67ed-499c-b3da-a1d1b33166a5 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:55.085158 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:55.106277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65082127-6c9e-417c-a9a1-6939a0b271e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:55.106966 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65082127-6c9e-417c-a9a1-6939a0b271e7 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.107286 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65082127-6c9e-417c-a9a1-6939a0b271e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.107551 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65082127-6c9e-417c-a9a1-6939a0b271e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.120392 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65082127-6c9e-417c-a9a1-6939a0b271e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-65082127-6c9e-417c-a9a1-6939a0b271e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:55.127916 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:55.128998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:55.129796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 178/361] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:55.130932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee6cc-c03b-4a7a-97b5-c965690a4c0a None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.131204 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee6cc-c03b-4a7a-97b5-c965690a4c0a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.135034 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee6cc-c03b-4a7a-97b5-c965690a4c0a None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.135034 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 179/362] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:55.135034 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee6cc-c03b-4a7a-97b5-c965690a4c0a None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:55.190571 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:55.193965 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67cdc6-b556-4d22-825b-cf1597a0dc5c None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:55.246116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c0c5-24ff-411f-94dc-3fa6d6bc9ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:55.246787 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c0c5-24ff-411f-94dc-3fa6d6bc9ddc None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.247022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c0c5-24ff-411f-94dc-3fa6d6bc9ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.247440 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c0c5-24ff-411f-94dc-3fa6d6bc9ddc None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.248123 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c0c5-24ff-411f-94dc-3fa6d6bc9ddc None admin] RBAC: Adding query filter params (name=member) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:55.248425 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c0c5-24ff-411f-94dc-3fa6d6bc9ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:55.250570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c0c5-24ff-411f-94dc-3fa6d6bc9ddc None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:55.262854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 184/363] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:55.263063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee6cc-c03b-4a7a-97b5-c965690a4c0a None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:55.264265 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b2d7-a3c7-4035-b095-1d0e5b4a2552 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.264552 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b2d7-a3c7-4035-b095-1d0e5b4a2552 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.264821 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b2d7-a3c7-4035-b095-1d0e5b4a2552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.287285 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-15c5b2d7-a3c7-4035-b095-1d0e5b4a2552 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:55.288511 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-15c5b2d7-a3c7-4035-b095-1d0e5b4a2552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:55.316288 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:55.316915 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.317201 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.317461 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.318177 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] RBAC: Adding query filter params (role.id=ad59177e2ed34618b4eddfa1ba66c8c5, user.id=90f157b811434ecb97b8cc89db80d63c, scope.system=all) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:55.318473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:55.320559 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:55.334351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 180/364] 10.222.0.69 () {56 vars in 1308 bytes} [Fri Aug 19 02:26:55 2022] GET /identity/v3/role_assignments?user.id=90f157b811434ecb97b8cc89db80d63c&scope.system=all&role.id=ad59177e2ed34618b4eddfa1ba66c8c5 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:55.335237 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:55.377061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 185/365] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:55.379086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5b2d7-a3c7-4035-b095-1d0e5b4a2552 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:55.382124 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:55.482454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a82e4-4f38-4ad9-99a3-0b69e193df18 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:55.510801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:55.535543 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5b2d7-a3c7-4035-b095-1d0e5b4a2552 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:55.545925 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:55.546947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.547492 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.547942 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.548825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:55.549312 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:55.550895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:55.569504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 181/366] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:55.574841 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:55.659802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55395c-7cae-4a27-b5aa-49387fe7af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:55.660547 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55395c-7cae-4a27-b5aa-49387fe7af38 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.660811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55395c-7cae-4a27-b5aa-49387fe7af38 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.661072 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55395c-7cae-4a27-b5aa-49387fe7af38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.740443 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:55.753533 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df94f48-5cf5-4ef2-be42-eb1f9a82783d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:55.780489 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55395c-7cae-4a27-b5aa-49387fe7af38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:55.783018 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55395c-7cae-4a27-b5aa-49387fe7af38 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:55.823294 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452115a-3000-4e2e-82c0-d538baa4d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:55.824259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452115a-3000-4e2e-82c0-d538baa4d652 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:55.825517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452115a-3000-4e2e-82c0-d538baa4d652 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:55.826170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452115a-3000-4e2e-82c0-d538baa4d652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:55.932444 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452115a-3000-4e2e-82c0-d538baa4d652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:55.934209 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:55.934927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452115a-3000-4e2e-82c0-d538baa4d652 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:55.947050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 186/367] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:55.948295 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55395c-7cae-4a27-b5aa-49387fe7af38 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.042813 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:56.052111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 182/368] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:56.053453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452115a-3000-4e2e-82c0-d538baa4d652 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.062185 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55395c-7cae-4a27-b5aa-49387fe7af38 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:56.101869 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7532d-b389-4226-aff7-d29bdc427cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:56.103010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7532d-b389-4226-aff7-d29bdc427cef None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:56.103533 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7532d-b389-4226-aff7-d29bdc427cef None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:56.103866 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7532d-b389-4226-aff7-d29bdc427cef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:56.118173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7532d-b389-4226-aff7-d29bdc427cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-a5b7532d-b389-4226-aff7-d29bdc427cef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:56.122921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:56.123819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:56.124615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 187/369] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:56.125253 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7532d-b389-4226-aff7-d29bdc427cef None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.195041 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452115a-3000-4e2e-82c0-d538baa4d652 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:56.199373 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:56.253479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dfdf6-be75-47a0-b7f2-d810eefe2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:56.254275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dfdf6-be75-47a0-b7f2-d810eefe2289 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:56.254690 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dfdf6-be75-47a0-b7f2-d810eefe2289 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:56.254979 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dfdf6-be75-47a0-b7f2-d810eefe2289 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:56.256718 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dfdf6-be75-47a0-b7f2-d810eefe2289 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:56.258685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dfdf6-be75-47a0-b7f2-d810eefe2289 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:56.260935 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 183/370] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:56.261142 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7532d-b389-4226-aff7-d29bdc427cef None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:56.261838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dfdf6-be75-47a0-b7f2-d810eefe2289 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.307956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc9f21-3858-439b-8695-599a6d07dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:56.308611 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9f21-3858-439b-8695-599a6d07dc36 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:56.308882 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9f21-3858-439b-8695-599a6d07dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:56.309257 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9f21-3858-439b-8695-599a6d07dc36 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:56.310411 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc9f21-3858-439b-8695-599a6d07dc36 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:56.312785 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc9f21-3858-439b-8695-599a6d07dc36 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:56.314808 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 188/371] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:56.316640 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc9f21-3858-439b-8695-599a6d07dc36 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.349744 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:56.397904 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dfdf6-be75-47a0-b7f2-d810eefe2289 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:56.441157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:56.441901 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:56.442179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:56.442542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:56.443251 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:56.443555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:56.445116 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:56.449045 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc9f21-3858-439b-8695-599a6d07dc36 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:56.457053 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 184/372] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:56.457930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.476179 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:56.499875 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa17c8-1610-429c-a05c-cbecd7c898c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:56.500899 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa17c8-1610-429c-a05c-cbecd7c898c1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:56.501287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa17c8-1610-429c-a05c-cbecd7c898c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:56.501626 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa17c8-1610-429c-a05c-cbecd7c898c1 None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:56.502804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa17c8-1610-429c-a05c-cbecd7c898c1 None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:56.505566 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa17c8-1610-429c-a05c-cbecd7c898c1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:56.507345 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 189/373] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:56.508237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa17c8-1610-429c-a05c-cbecd7c898c1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.584020 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2d742-4c49-4f54-878f-743322d8ef3b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:56.620670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b5a3f-6d05-4339-834c-ab47b6153d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:56.621790 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5a3f-6d05-4339-834c-ab47b6153d1d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:56.622399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:56.622852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5a3f-6d05-4339-834c-ab47b6153d1d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:56.625338 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5a3f-6d05-4339-834c-ab47b6153d1d None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:56.628133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b5a3f-6d05-4339-834c-ab47b6153d1d None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:56.629932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b5a3f-6d05-4339-834c-ab47b6153d1d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:56.630212 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa17c8-1610-429c-a05c-cbecd7c898c1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:56.632147 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 185/374] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:56.633111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b5a3f-6d05-4339-834c-ab47b6153d1d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.677854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fcbb2-078a-48c0-835b-eb5cfdc44c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:56.678467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fcbb2-078a-48c0-835b-eb5cfdc44c9c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:56.678749 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fcbb2-078a-48c0-835b-eb5cfdc44c9c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:56.679008 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fcbb2-078a-48c0-835b-eb5cfdc44c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:56.751629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:56.772743 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b5a3f-6d05-4339-834c-ab47b6153d1d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:56.774876 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fcbb2-078a-48c0-835b-eb5cfdc44c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:56.785259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fcbb2-078a-48c0-835b-eb5cfdc44c9c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:56.826946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:56.828002 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:56.828450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:56.828949 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:56.829854 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] RBAC: Adding query filter params (group.id=9635382eee7942498e692114b1a26658, role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:56.830706 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:56.832528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:56.840309 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 186/375] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/role_assignments?group.id=9635382eee7942498e692114b1a26658&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:56.842097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.891551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 190/376] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:26:56.897745 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fcbb2-078a-48c0-835b-eb5cfdc44c9c None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:56.927335 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:56.994852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e83cc-a941-4681-8bd8-6977d57775d3 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:57.021857 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:57.039216 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fcbb2-078a-48c0-835b-eb5cfdc44c9c None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:57.094319 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a10ef-f159-4ed8-ae25-eaf100ceaa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:57.095447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a10ef-f159-4ed8-ae25-eaf100ceaa3a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:57.095940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a10ef-f159-4ed8-ae25-eaf100ceaa3a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:57.096441 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a10ef-f159-4ed8-ae25-eaf100ceaa3a None admin] PATH_INFO: `/v3/projects/ffd15eac07ca4582ba473f869ddd41c6` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:57.098349 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a10ef-f159-4ed8-ae25-eaf100ceaa3a None admin] RBAC: Authorizing `identity:get_project(project_id=ffd15eac07ca4582ba473f869ddd41c6)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:57.101021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a10ef-f159-4ed8-ae25-eaf100ceaa3a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:57.103544 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 191/377] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/projects/ffd15eac07ca4582ba473f869ddd41c6 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:57.110006 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a10ef-f159-4ed8-ae25-eaf100ceaa3a None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:57.122553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:57.123203 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:57.123473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:57.123734 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:57.124478 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] RBAC: Adding query filter params (group.id=9635382eee7942498e692114b1a26658, role.id=e7e1d965bd9b4d52a96f59ba3965c5ed, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:57.124769 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:57.126224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:57.141228 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 187/378] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:26:56 2022] GET /identity/v3/role_assignments?group.id=9635382eee7942498e692114b1a26658&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=e7e1d965bd9b4d52a96f59ba3965c5ed => generated 260 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:57.261257 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a10ef-f159-4ed8-ae25-eaf100ceaa3a None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:57.306736 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a002299-b451-4584-b935-d8df7f393e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:57.307892 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a002299-b451-4584-b935-d8df7f393e25 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:57.308383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a002299-b451-4584-b935-d8df7f393e25 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:57.308860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a002299-b451-4584-b935-d8df7f393e25 None admin] PATH_INFO: `/v3/groups/3c6b477e69404c9287ebb9107c707b58` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:57.320058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a002299-b451-4584-b935-d8df7f393e25 None admin] RBAC: Authorizing `identity:get_group(group_id=3c6b477e69404c9287ebb9107c707b58)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:57.321899 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a002299-b451-4584-b935-d8df7f393e25 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:57.324213 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 192/379] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:26:57 2022] GET /identity/v3/groups/3c6b477e69404c9287ebb9107c707b58 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:57.330528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:57.466954 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac1534-e1a8-435e-a241-2e01f844e652 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:57.495853 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:57.509427 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff58bc0-e42b-4158-997d-1917fb7bf603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:57.510048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58bc0-e42b-4158-997d-1917fb7bf603 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:57.510320 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58bc0-e42b-4158-997d-1917fb7bf603 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:57.510583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58bc0-e42b-4158-997d-1917fb7bf603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:57.511343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff58bc0-e42b-4158-997d-1917fb7bf603 None admin] RBAC: Adding query filter params (group.id=3c6b477e69404c9287ebb9107c707b58, role.id=22d22ddee1804d668628115534a289ab, scope.project.id=ffd15eac07ca4582ba473f869ddd41c6) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:57.511647 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff58bc0-e42b-4158-997d-1917fb7bf603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:57.513131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff58bc0-e42b-4158-997d-1917fb7bf603 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:57.519760 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 188/380] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:26:57 2022] GET /identity/v3/role_assignments?group.id=3c6b477e69404c9287ebb9107c707b58&scope.project.id=ffd15eac07ca4582ba473f869ddd41c6&role.id=22d22ddee1804d668628115534a289ab => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:57.741558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89b98-de1e-492c-9b2f-2ecd5e3a17b5 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:57.742210 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89b98-de1e-492c-9b2f-2ecd5e3a17b5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:57.742688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89b98-de1e-492c-9b2f-2ecd5e3a17b5 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:57.744283 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 193/381] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:57.750136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f08ce-d8cc-4285-a57a-dbce1e8a5742 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:57.750439 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f08ce-d8cc-4285-a57a-dbce1e8a5742 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:57.750677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f08ce-d8cc-4285-a57a-dbce1e8a5742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:57.774068 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-6f3f08ce-d8cc-4285-a57a-dbce1e8a5742 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:57.774068 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-6f3f08ce-d8cc-4285-a57a-dbce1e8a5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:57.865730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 189/382] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:57.889585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc21374-39b4-4e7f-a818-c61ecd8070e8 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:57.890195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc21374-39b4-4e7f-a818-c61ecd8070e8 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:57.890677 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc21374-39b4-4e7f-a818-c61ecd8070e8 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:57.892233 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 194/383] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:26:57.898614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abca2f-3193-47fb-acd7-ea16859c0644 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:57.898901 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abca2f-3193-47fb-acd7-ea16859c0644 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:57.899199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abca2f-3193-47fb-acd7-ea16859c0644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:57.926167 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-82abca2f-3193-47fb-acd7-ea16859c0644 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:57.927387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-82abca2f-3193-47fb-acd7-ea16859c0644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:58.008313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 190/384] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:26:58.462621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc21374-39b4-4e7f-a818-c61ecd8070e8 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:58.487328 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:58.584007 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc21374-39b4-4e7f-a818-c61ecd8070e8 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:58.597938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abca2f-3193-47fb-acd7-ea16859c0644 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:58.643753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dbdad-8e7a-4dbf-a603-dce4dfc97276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:58.644417 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dbdad-8e7a-4dbf-a603-dce4dfc97276 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:58.644693 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dbdad-8e7a-4dbf-a603-dce4dfc97276 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:58.644965 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dbdad-8e7a-4dbf-a603-dce4dfc97276 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:58.667187 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dbdad-8e7a-4dbf-a603-dce4dfc97276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-421dbdad-8e7a-4dbf-a603-dce4dfc97276 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:58.674061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:58.674943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:26:58.675746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:26:58.678743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 195/385] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:26:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:26:58.684236 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dbdad-8e7a-4dbf-a603-dce4dfc97276 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:58.712440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:58.778603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:58.821028 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dbdad-8e7a-4dbf-a603-dce4dfc97276 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:58.825089 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abca2f-3193-47fb-acd7-ea16859c0644 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:58.877377 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:58.878016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:58.878286 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:58.878686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:58.879397 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:58.879695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:58.880459 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c007-c2e0-49a3-a6b3-94dbbb41af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:58.881149 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:58.881537 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c007-c2e0-49a3-a6b3-94dbbb41af85 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:58.882006 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c007-c2e0-49a3-a6b3-94dbbb41af85 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:58.882483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c007-c2e0-49a3-a6b3-94dbbb41af85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:58.892112 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 196/386] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:26:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:26:58.901157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3c007-c2e0-49a3-a6b3-94dbbb41af85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-93b3c007-c2e0-49a3-a6b3-94dbbb41af85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:26:58.906131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:26:58.907157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:26:58.907970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:26:58.914646 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:58.915302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 191/387] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:26:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:26:58.921305 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c007-c2e0-49a3-a6b3-94dbbb41af85 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:59.107278 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc958-9f1a-4f4d-89a2-c917b9904638 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:59.166094 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c007-c2e0-49a3-a6b3-94dbbb41af85 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:59.167595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713aa87-5275-4665-914c-02998e7ed220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:59.169530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713aa87-5275-4665-914c-02998e7ed220 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.170156 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713aa87-5275-4665-914c-02998e7ed220 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.171978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713aa87-5275-4665-914c-02998e7ed220 None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.174006 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713aa87-5275-4665-914c-02998e7ed220 None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:59.177184 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713aa87-5275-4665-914c-02998e7ed220 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:59.181468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 197/388] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:26:58 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:59.185317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:59.190539 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713aa87-5275-4665-914c-02998e7ed220 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:59.231054 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:59.250771 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:59.251846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.252280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.252692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.254007 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:26:59.254462 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:59.256524 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:59.266341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 192/389] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:26:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:59.271763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:59.396453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab3f0b-4938-49cf-be3f-e44cd10f8df0 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:59.435035 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676792d-684f-486e-9338-a385ff973d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:59.436467 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676792d-684f-486e-9338-a385ff973d6c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.436890 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676792d-684f-486e-9338-a385ff973d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.437329 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676792d-684f-486e-9338-a385ff973d6c None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.438794 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676792d-684f-486e-9338-a385ff973d6c None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:59.440411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676792d-684f-486e-9338-a385ff973d6c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:59.442535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 193/390] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:26:59 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:59.447740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676792d-684f-486e-9338-a385ff973d6c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:59.462318 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713aa87-5275-4665-914c-02998e7ed220 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:59.496059 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:59.563752 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be550ea-b1dd-42b7-aa8b-50ca1a9a69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:59.564458 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be550ea-b1dd-42b7-aa8b-50ca1a9a69df None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.564682 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be550ea-b1dd-42b7-aa8b-50ca1a9a69df None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.564955 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be550ea-b1dd-42b7-aa8b-50ca1a9a69df None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.567122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676792d-684f-486e-9338-a385ff973d6c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:59.570118 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be550ea-b1dd-42b7-aa8b-50ca1a9a69df None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:59.571641 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be550ea-b1dd-42b7-aa8b-50ca1a9a69df None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:59.573621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 198/391] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:59 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:59.583981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be550ea-b1dd-42b7-aa8b-50ca1a9a69df None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:59.610832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e172-05f4-4ad6-a607-9e305cb83201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:59.613467 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e172-05f4-4ad6-a607-9e305cb83201 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.613745 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e172-05f4-4ad6-a607-9e305cb83201 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.614017 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e172-05f4-4ad6-a607-9e305cb83201 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.616466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483e172-05f4-4ad6-a607-9e305cb83201 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:59.617991 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483e172-05f4-4ad6-a607-9e305cb83201 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:59.624105 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 194/392] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:26:59 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:26:59.630234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e172-05f4-4ad6-a607-9e305cb83201 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:59.703561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:59.726248 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be550ea-b1dd-42b7-aa8b-50ca1a9a69df None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:59.789367 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506e9c-a824-4289-a919-c179ae43644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:59.790068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506e9c-a824-4289-a919-c179ae43644c None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.790341 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506e9c-a824-4289-a919-c179ae43644c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.790610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506e9c-a824-4289-a919-c179ae43644c None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f/groups/9635382eee7942498e692114b1a26658/roles/e7e1d965bd9b4d52a96f59ba3965c5ed` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.795542 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506e9c-a824-4289-a919-c179ae43644c None admin] RBAC: Authorizing `identity:create_grant(project_id=66d19a41099445d1876e9c42ba23261f, group_id=9635382eee7942498e692114b1a26658, role_id=e7e1d965bd9b4d52a96f59ba3965c5ed)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:59.797049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506e9c-a824-4289-a919-c179ae43644c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:59.827273 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 199/393] 10.222.0.69 () {58 vars in 1442 bytes} [Fri Aug 19 02:26:59 2022] PUT /identity/v3/projects/66d19a41099445d1876e9c42ba23261f/groups/9635382eee7942498e692114b1a26658/roles/e7e1d965bd9b4d52a96f59ba3965c5ed => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:26:59.835935 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a53706-4cd3-40e8-b061-6082190d06c6 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.836243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a53706-4cd3-40e8-b061-6082190d06c6 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.836483 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a53706-4cd3-40e8-b061-6082190d06c6 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.838226 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 200/394] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:59.844899 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b213-dadc-43ed-9214-4745a10dbc9f None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.845252 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b213-dadc-43ed-9214-4745a10dbc9f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.845485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b213-dadc-43ed-9214-4745a10dbc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.866068 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e172-05f4-4ad6-a607-9e305cb83201 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:59.868943 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:59.875320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-2fd0b213-dadc-43ed-9214-4745a10dbc9f None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:59.876582 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-2fd0b213-dadc-43ed-9214-4745a10dbc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:59.908882 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649a817-bbfb-4fe0-b6ac-e530d0ec0710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:59.909564 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a817-bbfb-4fe0-b6ac-e530d0ec0710 None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.909842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a817-bbfb-4fe0-b6ac-e530d0ec0710 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.910111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649a817-bbfb-4fe0-b6ac-e530d0ec0710 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f/groups/9635382eee7942498e692114b1a26658/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.912148 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649a817-bbfb-4fe0-b6ac-e530d0ec0710 None admin] RBAC: Authorizing `identity:create_grant(project_id=66d19a41099445d1876e9c42ba23261f, group_id=9635382eee7942498e692114b1a26658, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:59.913641 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649a817-bbfb-4fe0-b6ac-e530d0ec0710 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:59.934051 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 195/395] 10.222.0.69 () {58 vars in 1442 bytes} [Fri Aug 19 02:26:59 2022] PUT /identity/v3/projects/66d19a41099445d1876e9c42ba23261f/groups/9635382eee7942498e692114b1a26658/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:26:59.963661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19ce4-2b2b-409a-a328-0ee007012a4a None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.964038 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19ce4-2b2b-409a-a328-0ee007012a4a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.964317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19ce4-2b2b-409a-a328-0ee007012a4a None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.965690 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 196/396] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:26:59.971946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635164-95a2-429c-88a7-378295ea4c43 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:59.972250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635164-95a2-429c-88a7-378295ea4c43 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:59.972487 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635164-95a2-429c-88a7-378295ea4c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:59.993969 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-90635164-95a2-429c-88a7-378295ea4c43 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:59.995415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-90635164-95a2-429c-88a7-378295ea4c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:00.003225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 201/397] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:00.093448 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 197/398] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:00.407758 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b213-dadc-43ed-9214-4745a10dbc9f None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:00.445637 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90635164-95a2-429c-88a7-378295ea4c43 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:00.484509 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:00.538387 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b213-dadc-43ed-9214-4745a10dbc9f None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:00.586436 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05199e29-6d54-4b61-957b-2715829e2ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:00.587093 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199e29-6d54-4b61-957b-2715829e2ff9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:00.587371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199e29-6d54-4b61-957b-2715829e2ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:00.587634 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199e29-6d54-4b61-957b-2715829e2ff9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:00.599677 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199e29-6d54-4b61-957b-2715829e2ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-05199e29-6d54-4b61-957b-2715829e2ff9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:00.604339 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:00.605222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:00.606002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 202/399] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:00.607436 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807318-5262-4245-89da-830817a0dc98 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:00.607436 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807318-5262-4245-89da-830817a0dc98 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:00.607590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807318-5262-4245-89da-830817a0dc98 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:00.608988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 203/400] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:00.616978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd29c-ddd4-4ac6-9c30-0b847597ce31 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:00.617843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd29c-ddd4-4ac6-9c30-0b847597ce31 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:00.617843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd29c-ddd4-4ac6-9c30-0b847597ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:00.626784 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:00.640290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-84bfd29c-ddd4-4ac6-9c30-0b847597ce31 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:00.641754 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-84bfd29c-ddd4-4ac6-9c30-0b847597ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:00.643125 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90635164-95a2-429c-88a7-378295ea4c43 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:00.696690 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ea17-f0f6-4798-80a0-0883017db3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:00.697717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ea17-f0f6-4798-80a0-0883017db3ef None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:00.697991 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ea17-f0f6-4798-80a0-0883017db3ef None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:00.698259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ea17-f0f6-4798-80a0-0883017db3ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:00.710786 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8ea17-f0f6-4798-80a0-0883017db3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-11e8ea17-f0f6-4798-80a0-0883017db3ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:00.717095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:00.718330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:27:00.719152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:00.719770 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 198/401] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:00.722047 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ea17-f0f6-4798-80a0-0883017db3ef None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:00.743077 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 204/402] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:00.744127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd29c-ddd4-4ac6-9c30-0b847597ce31 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:00.846469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ea17-f0f6-4798-80a0-0883017db3ef None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:00.851745 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:00.893620 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd29c-ddd4-4ac6-9c30-0b847597ce31 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:00.909627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:00.910659 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:00.911139 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:00.911566 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:00.912394 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] RBAC: Adding query filter params (name=member) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:00.912884 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:00.914483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:00.933373 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 199/403] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:27:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:00.939463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:00.940277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:00.940954 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:00.941388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:00.941863 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:00.942675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:00.943087 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:00.944545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:00.958097 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 205/404] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:00.959446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:00.977350 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:01.066268 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f12f-2b5c-4842-b110-0a76a4016a93 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.087165 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:01.103236 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66244b-9764-4311-9768-d3c988d96697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.103877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66244b-9764-4311-9768-d3c988d96697 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.104154 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66244b-9764-4311-9768-d3c988d96697 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.104427 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66244b-9764-4311-9768-d3c988d96697 None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.105554 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66244b-9764-4311-9768-d3c988d96697 None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:01.107063 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66244b-9764-4311-9768-d3c988d96697 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:01.113357 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 206/405] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:27:00 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:01.114711 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66244b-9764-4311-9768-d3c988d96697 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:01.162164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a893b74-5986-4e64-b953-ac29daec5b70 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.212169 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31aa39-a8ce-45fa-9c18-03edadb7a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.212973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31aa39-a8ce-45fa-9c18-03edadb7a48b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.213247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31aa39-a8ce-45fa-9c18-03edadb7a48b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.213898 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31aa39-a8ce-45fa-9c18-03edadb7a48b None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.215186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31aa39-a8ce-45fa-9c18-03edadb7a48b None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:01.216761 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31aa39-a8ce-45fa-9c18-03edadb7a48b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:01.219764 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 200/406] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:27:00 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:01.220749 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31aa39-a8ce-45fa-9c18-03edadb7a48b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:01.233508 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66244b-9764-4311-9768-d3c988d96697 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.283508 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7451d-d842-46db-8ebe-27fa0c1575cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.284492 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7451d-d842-46db-8ebe-27fa0c1575cf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.284835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7451d-d842-46db-8ebe-27fa0c1575cf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.285562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7451d-d842-46db-8ebe-27fa0c1575cf None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.286771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7451d-d842-46db-8ebe-27fa0c1575cf None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:01.288916 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7451d-d842-46db-8ebe-27fa0c1575cf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:01.291262 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 207/407] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:27:01 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:01.292575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7451d-d842-46db-8ebe-27fa0c1575cf None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:01.328372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:01.349211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31aa39-a8ce-45fa-9c18-03edadb7a48b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.362597 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:01.390448 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c01091-74df-4380-b7f9-83437f438ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.391457 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c01091-74df-4380-b7f9-83437f438ea0 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.391864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c01091-74df-4380-b7f9-83437f438ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.392292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c01091-74df-4380-b7f9-83437f438ea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.403672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c01091-74df-4380-b7f9-83437f438ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-35c01091-74df-4380-b7f9-83437f438ea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:01.410331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:01.411440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:01.412403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:01.412993 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7451d-d842-46db-8ebe-27fa0c1575cf None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.419470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 201/408] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:01.420703 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c01091-74df-4380-b7f9-83437f438ea0 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:01.450686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeec54-5c16-4092-9baf-e6aa2d598ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.451451 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeec54-5c16-4092-9baf-e6aa2d598ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.451691 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeec54-5c16-4092-9baf-e6aa2d598ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.451967 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeec54-5c16-4092-9baf-e6aa2d598ce1 None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.453213 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbeec54-5c16-4092-9baf-e6aa2d598ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:01.455052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbeec54-5c16-4092-9baf-e6aa2d598ce1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:01.456788 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 208/409] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:27:01 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:01.457779 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeec54-5c16-4092-9baf-e6aa2d598ce1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:01.535423 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c01091-74df-4380-b7f9-83437f438ea0 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.574237 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47fd50-0263-4e4b-a2f7-0b4047c150fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.575239 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47fd50-0263-4e4b-a2f7-0b4047c150fc None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.575745 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47fd50-0263-4e4b-a2f7-0b4047c150fc None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.575925 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeec54-5c16-4092-9baf-e6aa2d598ce1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.576382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47fd50-0263-4e4b-a2f7-0b4047c150fc None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/groups/9635382eee7942498e692114b1a26658/roles/e7e1d965bd9b4d52a96f59ba3965c5ed` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.579096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47fd50-0263-4e4b-a2f7-0b4047c150fc None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51, group_id=9635382eee7942498e692114b1a26658, role_id=e7e1d965bd9b4d52a96f59ba3965c5ed)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:01.580740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47fd50-0263-4e4b-a2f7-0b4047c150fc None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:01.597673 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 202/410] 10.222.0.69 () {58 vars in 1442 bytes} [Fri Aug 19 02:27:01 2022] PUT /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/groups/9635382eee7942498e692114b1a26658/roles/e7e1d965bd9b4d52a96f59ba3965c5ed => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:27:01.598832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47fd50-0263-4e4b-a2f7-0b4047c150fc None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:01.607180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:01.633255 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.633842 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.634116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.634383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.635072 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:01.635491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:01.636894 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:01.654060 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 209/411] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:01.664969 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:01.665745 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:01.738867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47fd50-0263-4e4b-a2f7-0b4047c150fc None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.794576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9a79-91e2-498a-a39c-7254375f9c7e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:01.825076 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dd8c6-2c83-4644-8463-d5a0b02d9edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.825816 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd8c6-2c83-4644-8463-d5a0b02d9edc None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.826088 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd8c6-2c83-4644-8463-d5a0b02d9edc None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.826395 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd8c6-2c83-4644-8463-d5a0b02d9edc None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/groups/9635382eee7942498e692114b1a26658/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.830079 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc868b-3303-4780-b7a6-8067c3bae857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:01.830432 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dd8c6-2c83-4644-8463-d5a0b02d9edc None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51, group_id=9635382eee7942498e692114b1a26658, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:01.830718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc868b-3303-4780-b7a6-8067c3bae857 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:01.830986 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc868b-3303-4780-b7a6-8067c3bae857 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:01.831293 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc868b-3303-4780-b7a6-8067c3bae857 None admin] PATH_INFO: `/v3/groups/3c6b477e69404c9287ebb9107c707b58` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:01.831904 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dd8c6-2c83-4644-8463-d5a0b02d9edc None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:01.832399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc868b-3303-4780-b7a6-8067c3bae857 None admin] RBAC: Authorizing `identity:get_group(group_id=3c6b477e69404c9287ebb9107c707b58)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:01.833827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc868b-3303-4780-b7a6-8067c3bae857 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:01.835773 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 210/412] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:27:01 2022] GET /identity/v3/groups/3c6b477e69404c9287ebb9107c707b58 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:01.841173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc868b-3303-4780-b7a6-8067c3bae857 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:01.855443 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 203/413] 10.222.0.69 () {58 vars in 1442 bytes} [Fri Aug 19 02:27:01 2022] PUT /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51/groups/9635382eee7942498e692114b1a26658/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:27:01.911489 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:01.969747 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc868b-3303-4780-b7a6-8067c3bae857 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:02.018783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478be50a-8fb5-42b1-81ed-4f1651906ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:02.019631 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478be50a-8fb5-42b1-81ed-4f1651906ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:02.019904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478be50a-8fb5-42b1-81ed-4f1651906ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:02.020169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478be50a-8fb5-42b1-81ed-4f1651906ed5 None admin] PATH_INFO: `/v3/projects/ffd15eac07ca4582ba473f869ddd41c6` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:02.021484 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478be50a-8fb5-42b1-81ed-4f1651906ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd15eac07ca4582ba473f869ddd41c6)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:02.023136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478be50a-8fb5-42b1-81ed-4f1651906ed5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:02.025222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 211/414] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:27:01 2022] GET /identity/v3/projects/ffd15eac07ca4582ba473f869ddd41c6 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:02.031251 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dd8c6-2c83-4644-8463-d5a0b02d9edc None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:02.126472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:02.172369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dd8c6-2c83-4644-8463-d5a0b02d9edc None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:02.213711 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98f88d-d2a4-4666-a64f-600b447b61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:02.214402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f88d-d2a4-4666-a64f-600b447b61bc None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:02.214679 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f88d-d2a4-4666-a64f-600b447b61bc None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:02.214951 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f88d-d2a4-4666-a64f-600b447b61bc None admin] PATH_INFO: `/v3/projects/ffd15eac07ca4582ba473f869ddd41c6/groups/3c6b477e69404c9287ebb9107c707b58/roles/22d22ddee1804d668628115534a289ab` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:02.216965 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f88d-d2a4-4666-a64f-600b447b61bc None admin] RBAC: Authorizing `identity:create_grant(project_id=ffd15eac07ca4582ba473f869ddd41c6, group_id=3c6b477e69404c9287ebb9107c707b58, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:02.218779 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f88d-d2a4-4666-a64f-600b447b61bc None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:02.242754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 204/415] 10.222.0.69 () {58 vars in 1442 bytes} [Fri Aug 19 02:27:02 2022] PUT /identity/v3/projects/ffd15eac07ca4582ba473f869ddd41c6/groups/3c6b477e69404c9287ebb9107c707b58/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:27:02.565431 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a320-9de8-47cf-9efe-7d788e2e8600 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:02.565754 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a320-9de8-47cf-9efe-7d788e2e8600 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:02.565966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a320-9de8-47cf-9efe-7d788e2e8600 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:02.567573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 212/416] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:02.574656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48dcda-998f-4365-9dc3-79a0f0dd6156 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:02.574981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48dcda-998f-4365-9dc3-79a0f0dd6156 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:02.575234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48dcda-998f-4365-9dc3-79a0f0dd6156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:02.597997 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-6d48dcda-998f-4365-9dc3-79a0f0dd6156 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:02.599258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-6d48dcda-998f-4365-9dc3-79a0f0dd6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:02.680577 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 205/417] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:02.746346 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679d99-d3f7-496c-ac57-11a91c8ba322 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:02.746864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679d99-d3f7-496c-ac57-11a91c8ba322 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:02.746864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679d99-d3f7-496c-ac57-11a91c8ba322 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:02.748581 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 213/418] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:02.753717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e50ce-725b-417c-8686-71e04815f205 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:02.754000 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e50ce-725b-417c-8686-71e04815f205 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:02.754267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e50ce-725b-417c-8686-71e04815f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:02.784052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-848e50ce-725b-417c-8686-71e04815f205 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:02.785292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-848e50ce-725b-417c-8686-71e04815f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:02.845766 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:02.869321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 206/419] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:03.152874 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679d99-d3f7-496c-ac57-11a91c8ba322 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:03.268904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679d99-d3f7-496c-ac57-11a91c8ba322 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:03.292745 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:03.305535 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f21da-5a7c-413a-acda-1162917c79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:03.306172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f21da-5a7c-413a-acda-1162917c79c9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:03.306439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f21da-5a7c-413a-acda-1162917c79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:03.306703 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f21da-5a7c-413a-acda-1162917c79c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:03.317786 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f21da-5a7c-413a-acda-1162917c79c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-832f21da-5a7c-413a-acda-1162917c79c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:03.322549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:03.323446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:03.324630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 214/420] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:03.330260 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e50ce-725b-417c-8686-71e04815f205 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:03.360470 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f21da-5a7c-413a-acda-1162917c79c9 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:03.455529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e50ce-725b-417c-8686-71e04815f205 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:03.493433 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:03.494039 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:03.494308 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:03.494568 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:03.495259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:03.495550 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:03.496917 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:03.509238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 207/421] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:03.515780 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:03.599350 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:03.654844 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a2dfa-02e5-45d5-b58b-d1a98ccfe445 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:03.689278 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988d2d-2c9a-49f2-8ea1-ecc94210f905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:03.689927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988d2d-2c9a-49f2-8ea1-ecc94210f905 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:03.690165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988d2d-2c9a-49f2-8ea1-ecc94210f905 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:03.690419 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988d2d-2c9a-49f2-8ea1-ecc94210f905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:03.717151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f21da-5a7c-413a-acda-1162917c79c9 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:03.761744 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab988d2d-2c9a-49f2-8ea1-ecc94210f905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:03.763365 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab988d2d-2c9a-49f2-8ea1-ecc94210f905 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:03.813399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:03.875020 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 208/422] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:03.875740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988d2d-2c9a-49f2-8ea1-ecc94210f905 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:03.907769 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd734-332b-4ffa-b901-b71faa06fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:03.908549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd734-332b-4ffa-b901-b71faa06fd24 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:03.908680 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd734-332b-4ffa-b901-b71faa06fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:03.908950 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd734-332b-4ffa-b901-b71faa06fd24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:03.959630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acd734-332b-4ffa-b901-b71faa06fd24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-43acd734-332b-4ffa-b901-b71faa06fd24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:03.965704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:03.966837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:27:03.968075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:03.977495 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 215/423] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 617 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:03.988266 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd734-332b-4ffa-b901-b71faa06fd24 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:04.009548 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988d2d-2c9a-49f2-8ea1-ecc94210f905 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:04.068032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a91-b91e-46f6-9040-aec841fd8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:04.068672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a91-b91e-46f6-9040-aec841fd8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.068947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a91-b91e-46f6-9040-aec841fd8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.069272 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a91-b91e-46f6-9040-aec841fd8ae6 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.070403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2a91-b91e-46f6-9040-aec841fd8ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:04.071890 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2a91-b91e-46f6-9040-aec841fd8ae6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:04.074104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 209/424] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:27:03 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:04.083876 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a91-b91e-46f6-9040-aec841fd8ae6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:04.131968 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:04.157020 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:04.273974 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a91-b91e-46f6-9040-aec841fd8ae6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:04.351994 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd98ba-2e29-4e63-80e3-34ac5e2b1fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:04.352635 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd98ba-2e29-4e63-80e3-34ac5e2b1fb5 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.352905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd98ba-2e29-4e63-80e3-34ac5e2b1fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.353168 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd98ba-2e29-4e63-80e3-34ac5e2b1fb5 None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.354369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd98ba-2e29-4e63-80e3-34ac5e2b1fb5 None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:04.357166 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd98ba-2e29-4e63-80e3-34ac5e2b1fb5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:04.363982 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 210/425] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:27:04 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:04.368387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd98ba-2e29-4e63-80e3-34ac5e2b1fb5 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:04.394510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd734-332b-4ffa-b901-b71faa06fd24 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:04.448498 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01490df-f021-4fcb-acfa-7da852ff9f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:04.449955 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01490df-f021-4fcb-acfa-7da852ff9f50 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.450231 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01490df-f021-4fcb-acfa-7da852ff9f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.450818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01490df-f021-4fcb-acfa-7da852ff9f50 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.451522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01490df-f021-4fcb-acfa-7da852ff9f50 None admin] RBAC: Adding query filter params (name=member) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:04.451968 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01490df-f021-4fcb-acfa-7da852ff9f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:04.453733 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01490df-f021-4fcb-acfa-7da852ff9f50 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:04.464802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 216/426] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:27:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:04.466575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c07ec8-14a6-4701-baca-1edc21e10ffb None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.467180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c07ec8-14a6-4701-baca-1edc21e10ffb None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.467454 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c07ec8-14a6-4701-baca-1edc21e10ffb None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.469281 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 217/427] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:04.470620 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c07ec8-14a6-4701-baca-1edc21e10ffb None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:04.500157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:04.524447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd98ba-2e29-4e63-80e3-34ac5e2b1fb5 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:04.567925 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60247e32-ff54-41bf-877b-90e637ec7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:04.568921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247e32-ff54-41bf-877b-90e637ec7ce5 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.569263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247e32-ff54-41bf-877b-90e637ec7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.569602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247e32-ff54-41bf-877b-90e637ec7ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.570574 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60247e32-ff54-41bf-877b-90e637ec7ce5 None admin] RBAC: Adding query filter params (group.id=9635382eee7942498e692114b1a26658, role.id=e7e1d965bd9b4d52a96f59ba3965c5ed, scope.project.id=66d19a41099445d1876e9c42ba23261f) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:04.570947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60247e32-ff54-41bf-877b-90e637ec7ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:04.573430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60247e32-ff54-41bf-877b-90e637ec7ce5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:04.581032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 211/428] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:27:04 2022] GET /identity/v3/role_assignments?group.id=9635382eee7942498e692114b1a26658&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=e7e1d965bd9b4d52a96f59ba3965c5ed => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:04.582370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ddb5a-ee69-4191-b5e7-5fdf560a971c None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.582660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ddb5a-ee69-4191-b5e7-5fdf560a971c None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.582936 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ddb5a-ee69-4191-b5e7-5fdf560a971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.591789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c07ec8-14a6-4701-baca-1edc21e10ffb None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:04.596298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:04.603214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b22ddb5a-ee69-4191-b5e7-5fdf560a971c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:04.604668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b22ddb5a-ee69-4191-b5e7-5fdf560a971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:04.638458 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ef9e-fb53-4aa4-a6ab-2b0aabdd83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:04.639156 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ef9e-fb53-4aa4-a6ab-2b0aabdd83e9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.639439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ef9e-fb53-4aa4-a6ab-2b0aabdd83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.639707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ef9e-fb53-4aa4-a6ab-2b0aabdd83e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.698366 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 212/429] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:04.699868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ffa8-cb43-4ec7-a38a-d8728644d856 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.700214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ffa8-cb43-4ec7-a38a-d8728644d856 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.700600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ffa8-cb43-4ec7-a38a-d8728644d856 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.702222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 213/430] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:04.707770 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023db9b4-4fef-4c71-98cd-73a5fb018fd5 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.708309 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023db9b4-4fef-4c71-98cd-73a5fb018fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.708736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023db9b4-4fef-4c71-98cd-73a5fb018fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.728442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-023db9b4-4fef-4c71-98cd-73a5fb018fd5 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:04.729970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-023db9b4-4fef-4c71-98cd-73a5fb018fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:04.769581 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65ef9e-fb53-4aa4-a6ab-2b0aabdd83e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:04.771162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65ef9e-fb53-4aa4-a6ab-2b0aabdd83e9 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:04.815372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 214/431] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:04.902312 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 218/432] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:04.907907 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023db9b4-4fef-4c71-98cd-73a5fb018fd5 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:04.923361 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:05.021140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023db9b4-4fef-4c71-98cd-73a5fb018fd5 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.062224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa3ff-4e3b-42ee-829e-1ad151d4da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.062855 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa3ff-4e3b-42ee-829e-1ad151d4da59 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.063155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa3ff-4e3b-42ee-829e-1ad151d4da59 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.063423 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa3ff-4e3b-42ee-829e-1ad151d4da59 None admin] PATH_INFO: `/v3/projects/66d19a41099445d1876e9c42ba23261f` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.064598 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffa3ff-4e3b-42ee-829e-1ad151d4da59 None admin] RBAC: Authorizing `identity:get_project(project_id=66d19a41099445d1876e9c42ba23261f)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:05.066143 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffa3ff-4e3b-42ee-829e-1ad151d4da59 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:05.068046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 215/433] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:27:04 2022] GET /identity/v3/projects/66d19a41099445d1876e9c42ba23261f => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:05.073450 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ef9e-fb53-4aa4-a6ab-2b0aabdd83e9 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:05.076718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:05.115453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa3ff-4e3b-42ee-829e-1ad151d4da59 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:05.182162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ef9e-fb53-4aa4-a6ab-2b0aabdd83e9 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.211856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:05.217217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad76feb-74fe-4530-8be3-cc62dd7cc4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.218201 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad76feb-74fe-4530-8be3-cc62dd7cc4e6 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.218476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad76feb-74fe-4530-8be3-cc62dd7cc4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.218738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad76feb-74fe-4530-8be3-cc62dd7cc4e6 None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.219862 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad76feb-74fe-4530-8be3-cc62dd7cc4e6 None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:05.221297 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad76feb-74fe-4530-8be3-cc62dd7cc4e6 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:05.222864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 219/434] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:27:05 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:05.222864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06f59-11e6-49fd-9e9e-55e91d490d3b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.222864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06f59-11e6-49fd-9e9e-55e91d490d3b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.222864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06f59-11e6-49fd-9e9e-55e91d490d3b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.222864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 220/435] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:05.222864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06f59-11e6-49fd-9e9e-55e91d490d3b None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:05.237674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa3ff-4e3b-42ee-829e-1ad151d4da59 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.270878 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0101-7c84-4d81-8ba4-844b18f515ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.271534 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0101-7c84-4d81-8ba4-844b18f515ec None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.271808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0101-7c84-4d81-8ba4-844b18f515ec None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.272075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0101-7c84-4d81-8ba4-844b18f515ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.281921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b0101-7c84-4d81-8ba4-844b18f515ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-728b0101-7c84-4d81-8ba4-844b18f515ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:05.287234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:05.288250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:05.289048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 216/436] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:05.289795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0101-7c84-4d81-8ba4-844b18f515ec None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:05.300555 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:05.331115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06f59-11e6-49fd-9e9e-55e91d490d3b None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.364818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c2a14-9847-46eb-9e5d-718e7cd50ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.365435 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2a14-9847-46eb-9e5d-718e7cd50ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.365707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2a14-9847-46eb-9e5d-718e7cd50ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.365966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2a14-9847-46eb-9e5d-718e7cd50ed0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.375525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c2a14-9847-46eb-9e5d-718e7cd50ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-984c2a14-9847-46eb-9e5d-718e7cd50ed0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:05.380394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:05.381324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:05.382101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 221/437] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:05.382802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365b50-01fd-459e-8e0a-de1728da731c None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.382964 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365b50-01fd-459e-8e0a-de1728da731c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.383294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365b50-01fd-459e-8e0a-de1728da731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.390499 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0101-7c84-4d81-8ba4-844b18f515ec None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.400477 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-38365b50-01fd-459e-8e0a-de1728da731c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:05.401657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-38365b50-01fd-459e-8e0a-de1728da731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:05.426245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.426846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.427152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.427417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.428134 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] RBAC: Adding query filter params (group.id=9635382eee7942498e692114b1a26658, role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=66d19a41099445d1876e9c42ba23261f) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:05.428434 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:05.429862 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:05.431645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:05.436556 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 217/438] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:27:05 2022] GET /identity/v3/role_assignments?group.id=9635382eee7942498e692114b1a26658&scope.project.id=66d19a41099445d1876e9c42ba23261f&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:05.437363 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:05.495026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 222/439] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:05.495026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38365b50-01fd-459e-8e0a-de1728da731c None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:05.557692 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:05.587886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f866d-c452-4ef1-ab97-af1bc5ad34a8 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.608256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38365b50-01fd-459e-8e0a-de1728da731c None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.633910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.634533 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.634812 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.635171 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.636318 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:05.636632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:05.638346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:05.648688 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 218/440] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:05.653885 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.654501 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.654787 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.657180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.657286 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:05.657361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] RBAC: Adding query filter params (name=member) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:05.657361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:05.657361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:05.668458 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 223/441] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:27:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:05.674073 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:05.736671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:05.796924 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3321-e614-4b8c-81da-26ee839cccd3 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.817626 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce3a8-43e3-47e6-98ec-52021c5749fb None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:05.843122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ef381-ea2f-4b71-8a8b-a2226edbefcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.843122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ef381-ea2f-4b71-8a8b-a2226edbefcb None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.843122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ef381-ea2f-4b71-8a8b-a2226edbefcb None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.843122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ef381-ea2f-4b71-8a8b-a2226edbefcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.848844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:05.862978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8503e-8c91-44df-99a0-38c8cdb3f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:05.864237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8503e-8c91-44df-99a0-38c8cdb3f1ed None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:05.864582 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8503e-8c91-44df-99a0-38c8cdb3f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:05.864921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8503e-8c91-44df-99a0-38c8cdb3f1ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:05.919307 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ef381-ea2f-4b71-8a8b-a2226edbefcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:05.921372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ef381-ea2f-4b71-8a8b-a2226edbefcb None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:05.951350 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8503e-8c91-44df-99a0-38c8cdb3f1ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:05.952832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8503e-8c91-44df-99a0-38c8cdb3f1ed None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:05.992360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.046137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 219/442] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:06.047372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ef381-ea2f-4b71-8a8b-a2226edbefcb None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.076325 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 224/443] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:27:06.080051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8503e-8c91-44df-99a0-38c8cdb3f1ed None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.105275 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.151224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ef381-ea2f-4b71-8a8b-a2226edbefcb None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.183735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8503e-8c91-44df-99a0-38c8cdb3f1ed None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.184870 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e9c7e-0d9d-4460-9c88-4070974b246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.185505 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e9c7e-0d9d-4460-9c88-4070974b246f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.185778 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e9c7e-0d9d-4460-9c88-4070974b246f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.186055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e9c7e-0d9d-4460-9c88-4070974b246f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.196041 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e9c7e-0d9d-4460-9c88-4070974b246f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-3e1e9c7e-0d9d-4460-9c88-4070974b246f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:06.200656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:06.201518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:06.202283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 220/444] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:06.202929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e9c7e-0d9d-4460-9c88-4070974b246f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.224160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9dea-9307-4ca8-8fc5-9f7ee8a27ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.224680 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.224811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9dea-9307-4ca8-8fc5-9f7ee8a27ccf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.225050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9dea-9307-4ca8-8fc5-9f7ee8a27ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.225312 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9dea-9307-4ca8-8fc5-9f7ee8a27ccf None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.226707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9dea-9307-4ca8-8fc5-9f7ee8a27ccf None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.227924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9dea-9307-4ca8-8fc5-9f7ee8a27ccf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.229531 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 225/445] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:06.230283 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9dea-9307-4ca8-8fc5-9f7ee8a27ccf None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.308541 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e9c7e-0d9d-4460-9c88-4070974b246f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.323551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.333139 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9dea-9307-4ca8-8fc5-9f7ee8a27ccf None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.350371 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719306c-1680-43ac-891e-a8d29d82567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.351021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719306c-1680-43ac-891e-a8d29d82567b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.351388 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719306c-1680-43ac-891e-a8d29d82567b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.351660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719306c-1680-43ac-891e-a8d29d82567b None admin] PATH_INFO: `/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.352852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719306c-1680-43ac-891e-a8d29d82567b None admin] RBAC: Authorizing `identity:get_project(project_id=f6e8c6946b0a4fe8b03904e3dc91ff51)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.354316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719306c-1680-43ac-891e-a8d29d82567b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.356021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 221/446] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/projects/f6e8c6946b0a4fe8b03904e3dc91ff51 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:06.356728 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719306c-1680-43ac-891e-a8d29d82567b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.369588 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.370191 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.370458 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.370718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.371409 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:06.371703 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.373169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.381541 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 226/447] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:06.382306 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.445205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.457504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719306c-1680-43ac-891e-a8d29d82567b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.479728 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146fb85-ae1b-435e-90fb-831efba5808d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.490121 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef04fb-4954-472e-a806-172d99faf21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.490746 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef04fb-4954-472e-a806-172d99faf21e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.490986 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef04fb-4954-472e-a806-172d99faf21e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.491313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef04fb-4954-472e-a806-172d99faf21e None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.492378 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef04fb-4954-472e-a806-172d99faf21e None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.493819 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef04fb-4954-472e-a806-172d99faf21e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.495439 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 222/448] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:06.496166 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef04fb-4954-472e-a806-172d99faf21e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.518123 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bc50-d14c-49d8-9b00-db5da0d81522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.518745 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bc50-d14c-49d8-9b00-db5da0d81522 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.519036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bc50-d14c-49d8-9b00-db5da0d81522 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.519298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bc50-d14c-49d8-9b00-db5da0d81522 None admin] PATH_INFO: `/v3/groups/9635382eee7942498e692114b1a26658` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.520421 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453bc50-d14c-49d8-9b00-db5da0d81522 None admin] RBAC: Authorizing `identity:get_group(group_id=9635382eee7942498e692114b1a26658)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.521859 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453bc50-d14c-49d8-9b00-db5da0d81522 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.523454 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 227/449] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/groups/9635382eee7942498e692114b1a26658 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:06.524200 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bc50-d14c-49d8-9b00-db5da0d81522 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.547706 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.601868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef04fb-4954-472e-a806-172d99faf21e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.634862 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad945db-4478-41aa-80fc-736be874647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.635501 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad945db-4478-41aa-80fc-736be874647d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.635769 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad945db-4478-41aa-80fc-736be874647d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.636053 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad945db-4478-41aa-80fc-736be874647d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.642690 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bc50-d14c-49d8-9b00-db5da0d81522 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.660642 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.675912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.676605 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.676884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.677149 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.677869 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] RBAC: Adding query filter params (group.id=9635382eee7942498e692114b1a26658, role.id=e7e1d965bd9b4d52a96f59ba3965c5ed, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:06.678169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.679630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.685421 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 228/450] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/role_assignments?group.id=9635382eee7942498e692114b1a26658&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=e7e1d965bd9b4d52a96f59ba3965c5ed => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:06.685986 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.711706 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad945db-4478-41aa-80fc-736be874647d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.713194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad945db-4478-41aa-80fc-736be874647d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.800832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.818632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785d49e-ba06-4f2b-aca7-ae3552203756 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.834893 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 223/451] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:06.836240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad945db-4478-41aa-80fc-736be874647d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:06.863988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.865042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.865042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.865407 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.866177 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] RBAC: Adding query filter params (group.id=9635382eee7942498e692114b1a26658, role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8, scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:06.866487 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.868099 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.879022 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 229/452] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/role_assignments?group.id=9635382eee7942498e692114b1a26658&scope.project.id=f6e8c6946b0a4fe8b03904e3dc91ff51&role.id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:06.905974 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:06.954953 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad945db-4478-41aa-80fc-736be874647d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:06.990743 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc32f-9c54-4f0c-a8f4-70c5387ec7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:06.991432 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc32f-9c54-4f0c-a8f4-70c5387ec7ea None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:06.991707 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc32f-9c54-4f0c-a8f4-70c5387ec7ea None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:06.991975 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc32f-9c54-4f0c-a8f4-70c5387ec7ea None admin] PATH_INFO: `/v3/projects/ffd15eac07ca4582ba473f869ddd41c6` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:06.993129 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc32f-9c54-4f0c-a8f4-70c5387ec7ea None admin] RBAC: Authorizing `identity:get_project(project_id=ffd15eac07ca4582ba473f869ddd41c6)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:06.994594 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc32f-9c54-4f0c-a8f4-70c5387ec7ea None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:06.996309 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 224/453] 10.222.0.69 () {56 vars in 1186 bytes} [Fri Aug 19 02:27:06 2022] GET /identity/v3/projects/ffd15eac07ca4582ba473f869ddd41c6 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:07.002406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:07.115715 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a27e3-607e-4c2e-a006-5b3a025fcfaf None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:07.152102 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d196b5-fef5-4cc5-b752-3389210f2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:07.152743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d196b5-fef5-4cc5-b752-3389210f2c5f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:07.153019 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d196b5-fef5-4cc5-b752-3389210f2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:07.153293 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d196b5-fef5-4cc5-b752-3389210f2c5f None admin] PATH_INFO: `/v3/groups/3c6b477e69404c9287ebb9107c707b58` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:07.154421 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d196b5-fef5-4cc5-b752-3389210f2c5f None admin] RBAC: Authorizing `identity:get_group(group_id=3c6b477e69404c9287ebb9107c707b58)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:07.155925 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d196b5-fef5-4cc5-b752-3389210f2c5f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:07.157542 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 230/454] 10.222.0.69 () {56 vars in 1180 bytes} [Fri Aug 19 02:27:07 2022] GET /identity/v3/groups/3c6b477e69404c9287ebb9107c707b58 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:07.163605 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc32f-9c54-4f0c-a8f4-70c5387ec7ea None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:07.268083 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc32f-9c54-4f0c-a8f4-70c5387ec7ea None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:07.291947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:07.304533 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d3a82-404d-4cd1-b919-95ac7b6feffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:07.305178 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d3a82-404d-4cd1-b919-95ac7b6feffa None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:07.305454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d3a82-404d-4cd1-b919-95ac7b6feffa None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:07.305722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d3a82-404d-4cd1-b919-95ac7b6feffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:07.306450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d3a82-404d-4cd1-b919-95ac7b6feffa None admin] RBAC: Adding query filter params (group.id=3c6b477e69404c9287ebb9107c707b58, role.id=22d22ddee1804d668628115534a289ab, scope.project.id=ffd15eac07ca4582ba473f869ddd41c6) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:07.306752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d3a82-404d-4cd1-b919-95ac7b6feffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:07.308227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d3a82-404d-4cd1-b919-95ac7b6feffa None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:07.314348 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 225/455] 10.222.0.69 () {56 vars in 1376 bytes} [Fri Aug 19 02:27:07 2022] GET /identity/v3/role_assignments?group.id=3c6b477e69404c9287ebb9107c707b58&scope.project.id=ffd15eac07ca4582ba473f869ddd41c6&role.id=22d22ddee1804d668628115534a289ab => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:09.818121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1800-5714-4256-bede-6b1746dfd3a5 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:09.819152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1800-5714-4256-bede-6b1746dfd3a5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:09.819630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1800-5714-4256-bede-6b1746dfd3a5 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:09.821471 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 231/456] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:09.827277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206b9c-6de1-4a28-ae41-32349168fcb1 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:09.828133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206b9c-6de1-4a28-ae41-32349168fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:09.828613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206b9c-6de1-4a28-ae41-32349168fcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:09.849461 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b1206b9c-6de1-4a28-ae41-32349168fcb1 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:09.851108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b1206b9c-6de1-4a28-ae41-32349168fcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:09.921924 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 226/457] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:10.007711 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc83c49-6bf4-4c8c-ae61-fa48eff2fe9b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.008057 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc83c49-6bf4-4c8c-ae61-fa48eff2fe9b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.008245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc83c49-6bf4-4c8c-ae61-fa48eff2fe9b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.009907 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 232/458] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:10.015308 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c0f1-83b4-4808-ad6c-7b5a2915c628 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.015525 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c0f1-83b4-4808-ad6c-7b5a2915c628 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.015796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c0f1-83b4-4808-ad6c-7b5a2915c628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.034643 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-c100c0f1-83b4-4808-ad6c-7b5a2915c628 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:10.035844 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-c100c0f1-83b4-4808-ad6c-7b5a2915c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:10.103864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 227/459] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:10.118509 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad96e-d4ac-418c-b35e-9300e3c2b312 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.118841 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad96e-d4ac-418c-b35e-9300e3c2b312 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.119145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad96e-d4ac-418c-b35e-9300e3c2b312 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.120551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 233/460] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:10.126056 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4423e79-6bdd-413d-9e4d-ea2e3769cdbf None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.126332 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4423e79-6bdd-413d-9e4d-ea2e3769cdbf None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.126602 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4423e79-6bdd-413d-9e4d-ea2e3769cdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.145722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b4423e79-6bdd-413d-9e4d-ea2e3769cdbf None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:10.146901 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b4423e79-6bdd-413d-9e4d-ea2e3769cdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:10.191378 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:10.215303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 228/461] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:10.253917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad96e-d4ac-418c-b35e-9300e3c2b312 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:10.276353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:10.370735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad96e-d4ac-418c-b35e-9300e3c2b312 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:10.404626 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:10.405245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.405518 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.405783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.416507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:10.418057 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:10.431815 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7dcaf-dbae-4350-a7f1-ab90c444b8c6 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.432104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7dcaf-dbae-4350-a7f1-ab90c444b8c6 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:10.432259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:10.433133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:10.434368 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:10.434368 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:10.434368 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:10.434542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7dcaf-dbae-4350-a7f1-ab90c444b8c6 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.434609 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 234/462] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:10.434674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 229/463] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:10.440047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:10.440258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f122b-8a50-4b3d-b39a-12f305216288 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.440561 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f122b-8a50-4b3d-b39a-12f305216288 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.440851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f122b-8a50-4b3d-b39a-12f305216288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.458137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b44f122b-8a50-4b3d-b39a-12f305216288 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:10.459407 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b44f122b-8a50-4b3d-b39a-12f305216288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:10.520739 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:10.530363 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 230/464] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:10.531479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f122b-8a50-4b3d-b39a-12f305216288 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:10.557985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc2661-de78-4afc-abe4-b16d9072e85c None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:10.594197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:10.594833 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.595134 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.595401 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.606870 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:10.608438 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:10.622851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:10.623990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:10.624843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:10.624843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:10.624843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:10.624843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 235/465] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:10.624843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:10.651855 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f122b-8a50-4b3d-b39a-12f305216288 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:10.662323 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:10.690148 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:10.690737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.691406 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.691406 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.692055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:10.692346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:10.693805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:10.707114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 231/466] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:10.707114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:10.733236 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917696da-edfc-449d-9b9c-8dd31abe9331 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:10.756120 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:10.775675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:10.776336 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.776808 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.777085 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.788243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:10.789715 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:10.804196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:10.805117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:10.805946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:10.805946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:10.805946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:10.805946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 236/467] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:10.806172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:10.822461 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8b67-67f7-401b-a7d7-36c0538591de None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:10.857586 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:10.858264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.858484 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.858749 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.859429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:10.859740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:10.861340 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:10.877543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 232/468] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:10.877543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:10.904290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:10.911541 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20779fa3-f0af-4650-85d4-6e94b8097988 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:10.943716 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceeaf3-7e33-413f-b601-bc4bc1fd1fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:10.944299 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceeaf3-7e33-413f-b601-bc4bc1fd1fb8 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:10.944569 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceeaf3-7e33-413f-b601-bc4bc1fd1fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:10.944835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceeaf3-7e33-413f-b601-bc4bc1fd1fb8 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:10.945468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcceeaf3-7e33-413f-b601-bc4bc1fd1fb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:10.946929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcceeaf3-7e33-413f-b601-bc4bc1fd1fb8 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:10.969640 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 237/469] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:27:10 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:10.970450 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceeaf3-7e33-413f-b601-bc4bc1fd1fb8 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:10.990683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504cd2-6b06-48a0-b6e1-ded0034e2e06 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:11.005632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:11.030223 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:11.030848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:11.031163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:11.031435 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:11.032086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:11.032388 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:11.033821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:11.052581 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 233/470] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:11.052581 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:11.096745 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceeaf3-7e33-413f-b601-bc4bc1fd1fb8 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:11.134178 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:11.135057 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:11.135165 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:11.135665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:11.147246 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:11.148855 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:11.155381 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:11.165386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:11.166525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:11.167791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:11.167791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:11.167791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:11.167791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 238/471] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:11.167791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:11.181164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f29ef-4650-4b05-a35d-dc41c58e7198 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:11.221779 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e18f5-f0ac-4bfc-961a-06576ead9b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:11.222411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e18f5-f0ac-4bfc-961a-06576ead9b04 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:11.222685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e18f5-f0ac-4bfc-961a-06576ead9b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:11.222949 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e18f5-f0ac-4bfc-961a-06576ead9b04 None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:11.223630 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e18f5-f0ac-4bfc-961a-06576ead9b04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:11.225075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e18f5-f0ac-4bfc-961a-06576ead9b04 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:11.247747 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 234/472] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:27:11 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:11.248661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e18f5-f0ac-4bfc-961a-06576ead9b04 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:11.272251 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:11.296708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d0ca7-ebf2-45f8-9071-545b322720fe None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:11.339575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a6fb-f835-4cf0-9e91-065a9a1add4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:11.340450 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a6fb-f835-4cf0-9e91-065a9a1add4e None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:11.341056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a6fb-f835-4cf0-9e91-065a9a1add4e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:11.341411 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a6fb-f835-4cf0-9e91-065a9a1add4e None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:11.342279 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068a6fb-f835-4cf0-9e91-065a9a1add4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:11.344393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068a6fb-f835-4cf0-9e91-065a9a1add4e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:11.380112 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 239/473] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:27:11 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:11.398861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e18f5-f0ac-4bfc-961a-06576ead9b04 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:11.441648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085f8e-0f8d-4644-85fa-13e6b0ca8306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:11.442344 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085f8e-0f8d-4644-85fa-13e6b0ca8306 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:11.442625 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085f8e-0f8d-4644-85fa-13e6b0ca8306 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:11.442897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085f8e-0f8d-4644-85fa-13e6b0ca8306 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:11.443607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c085f8e-0f8d-4644-85fa-13e6b0ca8306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:11.443913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c085f8e-0f8d-4644-85fa-13e6b0ca8306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:11.445832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c085f8e-0f8d-4644-85fa-13e6b0ca8306 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:11.460365 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 235/474] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:11.466680 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a6fb-f835-4cf0-9e91-065a9a1add4e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:11.588354 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a6fb-f835-4cf0-9e91-065a9a1add4e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:11.623985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aff1a8-734e-4bfe-b625-497f42c93133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:11.624603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aff1a8-734e-4bfe-b625-497f42c93133 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:11.624879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aff1a8-734e-4bfe-b625-497f42c93133 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:11.625149 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aff1a8-734e-4bfe-b625-497f42c93133 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:11.625808 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aff1a8-734e-4bfe-b625-497f42c93133 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:11.627287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aff1a8-734e-4bfe-b625-497f42c93133 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:11.637583 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:11.653167 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 240/475] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:27:11 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:27:13.231657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35856-eb70-4967-90d4-2c44da8f5429 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.232758 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35856-eb70-4967-90d4-2c44da8f5429 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.233242 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35856-eb70-4967-90d4-2c44da8f5429 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.235125 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 236/476] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:13.241021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37779b6-f39c-4099-ad5f-339eb94a98b9 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.241878 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37779b6-f39c-4099-ad5f-339eb94a98b9 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.242337 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37779b6-f39c-4099-ad5f-339eb94a98b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.262040 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-f37779b6-f39c-4099-ad5f-339eb94a98b9 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:13.263660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-f37779b6-f39c-4099-ad5f-339eb94a98b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:13.339108 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 241/477] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:13.574698 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cc7a-1d95-4f24-9653-227e51755462 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.574877 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cc7a-1d95-4f24-9653-227e51755462 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.575174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cc7a-1d95-4f24-9653-227e51755462 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.576963 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 237/478] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:13.582909 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238eb38-6122-44b8-b062-001e46912bdb None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.583263 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238eb38-6122-44b8-b062-001e46912bdb None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.583475 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238eb38-6122-44b8-b062-001e46912bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.602655 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-6238eb38-6122-44b8-b062-001e46912bdb None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:13.603858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-6238eb38-6122-44b8-b062-001e46912bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:13.677111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59cc7a-1d95-4f24-9653-227e51755462 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:13.678498 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 242/479] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:13.699377 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:13.726255 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213fc3b-bec1-4328-9950-80e2482d8e2c None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.726543 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213fc3b-bec1-4328-9950-80e2482d8e2c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.726822 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213fc3b-bec1-4328-9950-80e2482d8e2c None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.728486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 243/480] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:13.733940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca59dcc-5b19-40dd-8b92-285ea6da2f46 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.734228 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca59dcc-5b19-40dd-8b92-285ea6da2f46 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.734503 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca59dcc-5b19-40dd-8b92-285ea6da2f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.757261 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-8ca59dcc-5b19-40dd-8b92-285ea6da2f46 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:13.758521 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-8ca59dcc-5b19-40dd-8b92-285ea6da2f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:13.802613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59cc7a-1d95-4f24-9653-227e51755462 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:13.824843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:13.848829 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aed72c-2d27-4f20-a311-db0f5a9f1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:13.850013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed72c-2d27-4f20-a311-db0f5a9f1e19 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.850655 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed72c-2d27-4f20-a311-db0f5a9f1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.851316 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 244/481] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:13.851702 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed72c-2d27-4f20-a311-db0f5a9f1e19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.864590 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aed72c-2d27-4f20-a311-db0f5a9f1e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-c9aed72c-2d27-4f20-a311-db0f5a9f1e19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:13.869554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:13.870413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:13.871231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:13.873862 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 238/482] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:13.880062 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca59dcc-5b19-40dd-8b92-285ea6da2f46 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:13.917594 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0fbe4-3180-4818-8263-4c9188bbefc7 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.918212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0fbe4-3180-4818-8263-4c9188bbefc7 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.918715 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0fbe4-3180-4818-8263-4c9188bbefc7 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.920553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 239/483] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:13.925610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeda794-2791-4335-a52a-58d072cc6356 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:13.926117 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeda794-2791-4335-a52a-58d072cc6356 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:13.926581 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeda794-2791-4335-a52a-58d072cc6356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:13.947592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-dbeda794-2791-4335-a52a-58d072cc6356 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:13.949153 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-dbeda794-2791-4335-a52a-58d072cc6356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:13.984756 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca59dcc-5b19-40dd-8b92-285ea6da2f46 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.021154 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.021761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.022024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.022296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.022964 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:14.023288 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.023599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.025169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.032371 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 240/484] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:14.033009 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeda794-2791-4335-a52a-58d072cc6356 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.038155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 245/485] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:14.043445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.090018 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.142466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeda794-2791-4335-a52a-58d072cc6356 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.145270 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf2c1-86d1-4146-840d-e6cdd27b2e14 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.178915 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.179945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.180399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746102-7c92-4f07-ad3f-60e8ac42afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.180635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.181034 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746102-7c92-4f07-ad3f-60e8ac42afec None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.181314 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746102-7c92-4f07-ad3f-60e8ac42afec None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.181418 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.181565 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746102-7c92-4f07-ad3f-60e8ac42afec None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.192637 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d746102-7c92-4f07-ad3f-60e8ac42afec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:14.192912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.194301 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-8d746102-7c92-4f07-ad3f-60e8ac42afec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:14.197268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:14.198172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:14.199033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:14.203266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 241/486] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:14.204006 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746102-7c92-4f07-ad3f-60e8ac42afec None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:14.209801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:14.210723 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:14.211595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:14.211595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:14.211595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:14.215291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 246/487] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:14.216277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.261153 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.309269 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746102-7c92-4f07-ad3f-60e8ac42afec None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.322232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.327457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f700e0-f76f-422f-b80f-32f05d9a9464 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.344999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fe02-d809-4fd5-80be-4aad76ece09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.345555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fe02-d809-4fd5-80be-4aad76ece09f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.345824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fe02-d809-4fd5-80be-4aad76ece09f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.346087 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fe02-d809-4fd5-80be-4aad76ece09f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.357392 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665fe02-d809-4fd5-80be-4aad76ece09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-7665fe02-d809-4fd5-80be-4aad76ece09f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:14.362120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:14.363132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:14.364120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 242/488] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:14.365170 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.365279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fe02-d809-4fd5-80be-4aad76ece09f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.365370 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.365370 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.365370 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.365868 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:14.366170 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.367600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.376085 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 247/489] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:14.376896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.476579 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fe02-d809-4fd5-80be-4aad76ece09f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.485695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16a46-03e8-4fbd-a2da-12e376defa13 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.490662 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.512629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.513232 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.513507 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.513773 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.514439 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:14.514737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.516154 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.518877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e08218-adeb-4f7e-bef2-bd941dfbf524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.519545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e08218-adeb-4f7e-bef2-bd941dfbf524 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.519821 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e08218-adeb-4f7e-bef2-bd941dfbf524 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.520086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e08218-adeb-4f7e-bef2-bd941dfbf524 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.527418 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 243/490] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:14.528207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.530383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e08218-adeb-4f7e-bef2-bd941dfbf524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-f1e08218-adeb-4f7e-bef2-bd941dfbf524 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:14.535625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:14.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:14.537420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 248/491] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:14.538078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e08218-adeb-4f7e-bef2-bd941dfbf524 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.559190 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.630013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11d2d6-9983-4eba-b75c-52301ad6b494 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.637049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e08218-adeb-4f7e-bef2-bd941dfbf524 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.663271 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.663877 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.664154 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.664426 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.665093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] RBAC: Adding query filter params (name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:14.665395 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.666774 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.670439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.671096 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.671370 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.671645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.674468 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 244/492] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:14.675276 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.683612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.685079 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:14.699524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:14.700643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:14.701699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:14.701699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:14.701699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:14.701699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 249/493] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:14.701699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.714303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.775227 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.781765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91192169-1ada-4a3b-a977-6a808fd3672c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.806128 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4a43-b8ee-4682-9439-f3e459d74ace None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.814494 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.815156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.815429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.815695 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.823019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.824540 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:14.836948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:14.837867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 245/494] 10.222.0.69 () {56 vars in 1093 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:14.839071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.845206 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.845817 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.846088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.846356 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.847102 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:14.847433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.848865 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.856987 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 250/495] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:14.857843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:14.940287 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.947150 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeaf77-e2de-45ca-82ed-d5ead1a5faa1 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.956427 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616a52b-0454-492e-94f2-4015cdac27b5 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:14.981354 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.981978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.982248 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.982542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.989363 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:14.989941 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:14.990239 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:14.990511 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:14.991188 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:14.991467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.992837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:14.993427 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:14.994353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:14.994881 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.005243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 251/496] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:15.006053 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:15.010205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:15.011170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:15.012018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:15.012018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:15.012018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:15.012018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 246/497] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:15.012241 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.108369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6e730-1381-4c6e-9221-7aa062311452 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.114687 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff677df2-b9df-4f87-bdce-15b71c267e00 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.148100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.148702 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.148984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.149243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.149961 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:15.150252 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.151720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.156424 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.157062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.157340 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.157607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.168611 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.170077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.178607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:15.185723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:15.186861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:15.187765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:15.187765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:15.187765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:15.187765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 247/498] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:15.187975 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.195430 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 252/499] 10.222.0.69 () {56 vars in 1133 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:15.196202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.258087 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:15.305333 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcca91e-b7e0-47c4-aca6-c03644201866 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.306488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c992fce-d108-4900-8af2-a865dd95bbc9 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.339164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.339803 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.340031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.340460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.340460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] PATH_INFO: `/v3/users/glance` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.340651 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.340905 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.341168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.341806 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:15.342172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.343937 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.348438 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.349858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.354974 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 253/500] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:15.355781 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:15.361417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:15.362493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:27:15.363466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:15.367116 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 248/501] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:15.367964 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.428317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:15.455625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6db47-24a6-4f19-b7fe-99b459aa2685 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.468569 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:15.472230 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb087ab3-2893-4d4a-a08d-1af88f9ff77e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.489754 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.490359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.490632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.490899 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.491564 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:15.491862 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.493227 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.505251 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 254/502] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:15.505862 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.514113 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b7ff4-d89e-4c6c-b7da-726966ad7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.514726 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7ff4-d89e-4c6c-b7da-726966ad7705 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.515008 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7ff4-d89e-4c6c-b7da-726966ad7705 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.515299 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7ff4-d89e-4c6c-b7da-726966ad7705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.593078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b7ff4-d89e-4c6c-b7da-726966ad7705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.594550 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b7ff4-d89e-4c6c-b7da-726966ad7705 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.611738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002b6c-1469-4e17-9f76-285884fc7993 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.646103 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.646729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.647023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.647296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.652919 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:15.654385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.656187 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:15.668776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:15.669735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 255/503] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:15.670768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.699216 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 249/504] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:15.700259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b7ff4-d89e-4c6c-b7da-726966ad7705 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.709186 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:15.779653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3fc35-eb72-46df-ab6b-c31b210cd704 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.803467 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b7ff4-d89e-4c6c-b7da-726966ad7705 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.813890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.814592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.814876 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.815233 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.815965 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:15.816268 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.817735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.834452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 256/505] 10.222.0.69 () {56 vars in 1137 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:15.835273 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.840844 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.841479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.841752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.842018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.849674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.851153 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:15.862623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:15.863753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 250/506] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:15.864955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:15.889350 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:15.933897 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:15.946908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79528e-a169-413f-a02f-20ece8c4b220 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.966430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5c982-adae-4f01-8300-4056f0aec481 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:15.981026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:15.981606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:15.981883 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:15.982150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:15.982901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:15.983238 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:15.984689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.000056 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.000671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.000942 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.001226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.001345 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 257/507] 10.222.0.69 () {56 vars in 1137 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:16.002052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.012496 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.013954 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:16.027976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:16.029064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:16.034694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:16.034694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:16.034694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:16.034694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 251/508] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:16.034694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.100742 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:16.107199 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579f8e4-dd84-498c-a730-81209df19f23 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.130007 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62d56e-6cde-4c28-ae8f-1e88d4c38837 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.140245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e0b7-6eaf-4143-ab31-bfd74c18626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.140848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e0b7-6eaf-4143-ab31-bfd74c18626b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.141123 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e0b7-6eaf-4143-ab31-bfd74c18626b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.141394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e0b7-6eaf-4143-ab31-bfd74c18626b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.160832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:16.165686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.166296 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.166571 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.166838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.167596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:16.167897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.169343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.205352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 252/509] 10.222.0.69 () {56 vars in 1139 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:16.206185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.217142 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995e0b7-6eaf-4143-ab31-bfd74c18626b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.219240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995e0b7-6eaf-4143-ab31-bfd74c18626b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.307304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9312e-2e6c-4f02-b7c9-fb2a2fc6a147 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.317992 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 258/510] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:16.318841 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e0b7-6eaf-4143-ab31-bfd74c18626b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.337235 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:16.344019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c534f-2c78-471c-8824-9b9dccbe791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.344632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c534f-2c78-471c-8824-9b9dccbe791e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.344908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c534f-2c78-471c-8824-9b9dccbe791e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.345183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c534f-2c78-471c-8824-9b9dccbe791e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.369090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:16.413780 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c534f-2c78-471c-8824-9b9dccbe791e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.415317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c534f-2c78-471c-8824-9b9dccbe791e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.419150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e0b7-6eaf-4143-ab31-bfd74c18626b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.452510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655957e4-2510-4aef-ae19-452941614124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.453102 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655957e4-2510-4aef-ae19-452941614124 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.453378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655957e4-2510-4aef-ae19-452941614124 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.453647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655957e4-2510-4aef-ae19-452941614124 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.454332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655957e4-2510-4aef-ae19-452941614124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:16.454637 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655957e4-2510-4aef-ae19-452941614124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.456048 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655957e4-2510-4aef-ae19-452941614124 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.467244 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 259/511] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:16.468318 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655957e4-2510-4aef-ae19-452941614124 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.515646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 253/512] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:16.516499 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c534f-2c78-471c-8824-9b9dccbe791e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.545740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:16.577410 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655957e4-2510-4aef-ae19-452941614124 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.587065 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:16.613779 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2217d38-4053-48ef-84fa-611c1ee48bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.614383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217d38-4053-48ef-84fa-611c1ee48bfa None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.614659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217d38-4053-48ef-84fa-611c1ee48bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.614937 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217d38-4053-48ef-84fa-611c1ee48bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.617623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c534f-2c78-471c-8824-9b9dccbe791e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.650920 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.651569 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.651842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.652111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.662003 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.663497 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:16.677596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:16.678693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:16.679798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:16.679798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:16.679798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:16.679798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 254/513] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:16.679798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.684066 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2217d38-4053-48ef-84fa-611c1ee48bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.685593 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2217d38-4053-48ef-84fa-611c1ee48bfa None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.765227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:16.784064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc9e0-6cc5-46c3-86c5-f210b1747171 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.786197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 260/514] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:16.787070 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2217d38-4053-48ef-84fa-611c1ee48bfa None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.797046 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:16.820122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.820751 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.821023 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.821293 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.828098 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.829558 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:16.841451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:16.842509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:16.843763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:16.843763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:16.843763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:16.843763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:16.843763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:16.843763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:16.843763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:16.843763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:16.845629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 255/515] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:16.846499 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.892650 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2217d38-4053-48ef-84fa-611c1ee48bfa None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.925710 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.926194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.926434 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.926703 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.937417 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.938918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:16.953086 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:16.954148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:16.955238 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:16.955238 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:16.955238 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:16.955238 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 261/516] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:16.955484 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:16.959030 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af1865-10a2-498e-9b1b-6f4f5d01cb96 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:16.992016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:16.992617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:16.992892 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:16.993158 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:16.993789 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:16.994084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:16.995484 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.006869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 256/517] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:17.007694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.010476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:17.013695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:17.054244 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e720e-07fd-4493-b383-b86550f01070 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.087905 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.088529 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.088801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.089056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.099901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.101353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.107393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8052-48ca-471d-a66e-1ee48ff8ec29 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:17.115395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:17.116317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:17.117336 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:17.117336 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:17.117336 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:17.117336 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 262/518] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:17.117336 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.144736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.145343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.145618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.145887 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.146578 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:17.146884 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.148386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.166739 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 257/519] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:17.167996 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.232396 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a59657-6984-47fa-b6ef-e63a4237310a None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.245896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:17.257545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:17.267804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.268407 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.268682 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.268966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.269596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:17.269890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.271292 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.282844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 263/520] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:17.283696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.296224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce4b6e-0725-46da-a87b-e7fd7e190990 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.331332 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.331943 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.332162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.332432 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.339269 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.340736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:17.352090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:17.352934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:17.353776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 258/521] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:17.354599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.389719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d900c-8035-4c1f-9bc2-13df0f1ae681 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.423814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.424424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.424695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.424963 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.425594 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:17.425890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.427314 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.438293 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 264/522] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:17.439097 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.462484 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095a0b7-872a-493f-9625-396e75d222b8 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.470254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:17.496438 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:17.518650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.519368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.519660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.519932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.522587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=c27846f3ffc54cbcb0131c160d19c754) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:17.522906 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.524404 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.530299 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 259/523] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/role_assignments?user.id=c27846f3ffc54cbcb0131c160d19c754&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:17.530911 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.542837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3deae2-cc17-4897-9bcd-0681cbee0730 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.581881 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.582439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.582712 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.582976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.591036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.593020 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:17.606537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:17.607574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 265/524] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:17.614059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.665530 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888235b-febc-4e21-9fde-63b13f2dd34e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.704679 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.705295 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.705573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.705851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.706540 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:17.706842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.708340 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.712072 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:17.722307 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 260/525] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:17.723381 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.725834 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947252f2-a3f7-4d45-9858-41a566ae22ba None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.766413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.767162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.767504 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.767844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.776377 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.777681 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.782114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:17.789174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:17.790023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:17.790971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 266/526] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:17.791488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.844869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930a94c-7b87-4966-890b-ee57dcf2f4fe None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.882223 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.882831 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.883146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.883415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.884107 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:17.884410 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.885846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.902226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 261/527] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:17.902226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.913678 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c4302-7c44-4f63-a599-0cf906211365 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:17.954689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:17.955324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:17.955600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:17.955867 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:17.956651 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=3eb9db2887ee4e81aee4a4e2228f0add) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:17.956960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:17.958424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:17.971027 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 267/528] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/role_assignments?user.id=3eb9db2887ee4e81aee4a4e2228f0add&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:17.971027 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:17.991632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:18.020411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc181c22-d087-4ee7-af90-60e5cb29cc90 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:18.029912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:18.068084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:18.068988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:18.069269 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:18.069543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:18.070259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:18.070562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:18.072424 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:18.094852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 262/529] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:18.096450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:18.098032 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d12e27-25cc-4be8-866d-1bcc67b8341a None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:18.135689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eebf5f-5e21-4b0f-b8c4-1d24b645b53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:18.136307 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eebf5f-5e21-4b0f-b8c4-1d24b645b53f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:18.136585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eebf5f-5e21-4b0f-b8c4-1d24b645b53f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:18.136850 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eebf5f-5e21-4b0f-b8c4-1d24b645b53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:18.137576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eebf5f-5e21-4b0f-b8c4-1d24b645b53f None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=5c679a1bdee541f2830dce7ee89e60f5) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:18.137879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eebf5f-5e21-4b0f-b8c4-1d24b645b53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:18.139436 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eebf5f-5e21-4b0f-b8c4-1d24b645b53f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:18.146329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 268/530] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:17 2022] GET /identity/v3/role_assignments?user.id=5c679a1bdee541f2830dce7ee89e60f5&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:18.221352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000d91b-ab75-4631-a07a-8cc6e64b90a3 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:18.260515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc180ac-b965-4838-ac0b-c4eabf4d3c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:18.261201 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc180ac-b965-4838-ac0b-c4eabf4d3c83 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:18.261474 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc180ac-b965-4838-ac0b-c4eabf4d3c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:18.261741 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc180ac-b965-4838-ac0b-c4eabf4d3c83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:18.262545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc180ac-b965-4838-ac0b-c4eabf4d3c83 None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=69dafc33dd0d4f85822f8d54af542ee3) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:18.262853 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc180ac-b965-4838-ac0b-c4eabf4d3c83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:18.264479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc180ac-b965-4838-ac0b-c4eabf4d3c83 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:18.271239 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 263/531] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:18 2022] GET /identity/v3/role_assignments?user.id=69dafc33dd0d4f85822f8d54af542ee3&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:19.730966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f078ae-41dc-4ecd-8d77-3caf955c6d3f None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:19.731535 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f078ae-41dc-4ecd-8d77-3caf955c6d3f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:19.731535 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f078ae-41dc-4ecd-8d77-3caf955c6d3f None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:19.733158 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 269/532] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:19.739247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787205bd-327f-418a-a970-91eb84ebb023 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:19.739693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787205bd-327f-418a-a970-91eb84ebb023 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:19.739777 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787205bd-327f-418a-a970-91eb84ebb023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:19.758278 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-787205bd-327f-418a-a970-91eb84ebb023 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:19.759502 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-787205bd-327f-418a-a970-91eb84ebb023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:19.786501 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:19.834185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 264/533] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:20.158664 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f078ae-41dc-4ecd-8d77-3caf955c6d3f None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:20.216781 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da1ea-6e07-4f43-a10c-c7a1e0bc49fc None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.217154 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da1ea-6e07-4f43-a10c-c7a1e0bc49fc None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.217374 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da1ea-6e07-4f43-a10c-c7a1e0bc49fc None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.219384 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 265/534] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:20.224507 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95751ff-54cb-4e1d-9877-eae3b5c19c21 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.224792 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95751ff-54cb-4e1d-9877-eae3b5c19c21 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.225065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95751ff-54cb-4e1d-9877-eae3b5c19c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.243960 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-c95751ff-54cb-4e1d-9877-eae3b5c19c21 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:20.245202 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-c95751ff-54cb-4e1d-9877-eae3b5c19c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:20.248107 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:20.271199 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f078ae-41dc-4ecd-8d77-3caf955c6d3f None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:20.308403 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80912a1-e8e0-4389-8626-8aabf56c95cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:20.309029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80912a1-e8e0-4389-8626-8aabf56c95cd None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.309343 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80912a1-e8e0-4389-8626-8aabf56c95cd None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.309609 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80912a1-e8e0-4389-8626-8aabf56c95cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.321317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80912a1-e8e0-4389-8626-8aabf56c95cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-c80912a1-e8e0-4389-8626-8aabf56c95cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:20.326105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:20.327476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:20.328320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:20.333189 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 270/535] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:20.334503 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80912a1-e8e0-4389-8626-8aabf56c95cd None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:20.344832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 266/536] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:20.433932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09744868-cdae-48f1-9e9f-b2b050b917f2 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.434298 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09744868-cdae-48f1-9e9f-b2b050b917f2 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.434667 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09744868-cdae-48f1-9e9f-b2b050b917f2 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.436472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 267/537] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:20.441650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f443-3679-495e-8970-e14795b6da08 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.441927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f443-3679-495e-8970-e14795b6da08 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.442199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f443-3679-495e-8970-e14795b6da08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.445168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80912a1-e8e0-4389-8626-8aabf56c95cd None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:20.461669 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-a249f443-3679-495e-8970-e14795b6da08 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:20.463078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-a249f443-3679-495e-8970-e14795b6da08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:20.487138 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:20.487756 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.487996 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.488273 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.488943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:20.489245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:20.490638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:20.503038 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 271/538] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:20.506225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:20.509385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:20.548545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 268/539] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:20.550096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b3ad-9a4c-49f7-a45f-74d5f818e712 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.550694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b3ad-9a4c-49f7-a45f-74d5f818e712 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.551189 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b3ad-9a4c-49f7-a45f-74d5f818e712 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.552824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 269/540] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:20.557673 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa770e-27e3-4f6a-817b-6f5b632d1cda None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.557948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa770e-27e3-4f6a-817b-6f5b632d1cda None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.558225 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa770e-27e3-4f6a-817b-6f5b632d1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.577440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-74aa770e-27e3-4f6a-817b-6f5b632d1cda None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:20.578793 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-74aa770e-27e3-4f6a-817b-6f5b632d1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:20.593929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:20.623657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66cec-f9bf-41ec-9bd1-c03ae9ca8afe None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:20.659166 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 270/541] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:20.665670 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:20.666591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.667157 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.667626 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.669836 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa770e-27e3-4f6a-817b-6f5b632d1cda None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:20.682418 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:20.684185 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:20.698958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:20.699906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:20.700774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:20.700774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:20.700774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:20.700774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 272/542] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:20.705697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:20.782192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:20.805827 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa770e-27e3-4f6a-817b-6f5b632d1cda None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:20.829677 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2648-6fad-495e-abca-7d6eb1b11eea None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:20.842283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c7a3-74ae-4394-93f1-03b4403d5a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:20.843529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c7a3-74ae-4394-93f1-03b4403d5a55 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.843970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c7a3-74ae-4394-93f1-03b4403d5a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.844425 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c7a3-74ae-4394-93f1-03b4403d5a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.855292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9c7a3-74ae-4394-93f1-03b4403d5a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-7dd9c7a3-74ae-4394-93f1-03b4403d5a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:20.860575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:20.861449 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:20.862231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:20.865040 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 271/543] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:20.865507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:20.866209 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:20.866493 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:20.866764 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:20.871061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:20.871061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:20.871061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:20.872352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c7a3-74ae-4394-93f1-03b4403d5a55 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:20.882590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 273/544] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:20.883468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:20.887341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:20.981316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c7a3-74ae-4394-93f1-03b4403d5a55 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:20.989493 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcceac-b627-472a-bc4b-2667f61254c5 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.004163 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.015128 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.015737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.016007 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.016274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.016963 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] RBAC: Adding query filter params (name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:21.017266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.018695 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.024791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4464-bdeb-4da4-a9bc-26e8fa263f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.025418 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4464-bdeb-4da4-a9bc-26e8fa263f76 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.025693 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4464-bdeb-4da4-a9bc-26e8fa263f76 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.025962 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4464-bdeb-4da4-a9bc-26e8fa263f76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.026940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 272/545] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:21.027716 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.036918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f4464-bdeb-4da4-a9bc-26e8fa263f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-462f4464-bdeb-4da4-a9bc-26e8fa263f76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:21.041804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:21.042696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:21.043540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 274/546] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:21.044190 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4464-bdeb-4da4-a9bc-26e8fa263f76 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.100244 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.130318 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0711-ed2c-4a31-babf-f318f3206e09 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.141522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4464-bdeb-4da4-a9bc-26e8fa263f76 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.163408 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.164035 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.164303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.164573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.172825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.174254 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.176097 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f054cb7-edbd-423b-a0c0-3cd87a9c711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.176716 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054cb7-edbd-423b-a0c0-3cd87a9c711d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.176981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054cb7-edbd-423b-a0c0-3cd87a9c711d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.177242 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f054cb7-edbd-423b-a0c0-3cd87a9c711d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:21.185065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:21.186194 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 273/547] 10.222.0.69 () {56 vars in 1093 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:21.187349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.188884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f054cb7-edbd-423b-a0c0-3cd87a9c711d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-2f054cb7-edbd-423b-a0c0-3cd87a9c711d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:21.194601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:21.195988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 275/548] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:21.196853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f054cb7-edbd-423b-a0c0-3cd87a9c711d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.234408 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.298693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d682-62da-4c4d-9882-73d431351ce6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.301215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f054cb7-edbd-423b-a0c0-3cd87a9c711d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.328218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.333710 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.334343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.334619 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.334716 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.334889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.335305 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.335590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.335855 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.336523 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:21.336862 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.338216 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.346055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.351272 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 276/549] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:21.351272 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.351511 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:21.364345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:21.365236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:21.366211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:21.366211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:21.366211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:21.370282 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 274/550] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:21.370975 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.443979 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.451069 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7af58-1108-4261-9b79-34562e3de11d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.471371 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137cd13-9219-4337-ac78-6990453a150a None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.484968 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.485419 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.485695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.485974 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.486695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:21.487368 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.488462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.506794 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.506961 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 277/551] 10.222.0.69 () {56 vars in 1133 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:21.507439 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.507693 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.507810 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.508098 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.508764 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:21.509065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.510430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.520455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 275/552] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:21.520455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.569446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.609156 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf5a1-99f1-4b51-9080-30d06fbe4387 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.628639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5757e-b008-4151-9cf8-bb070c473af0 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.645029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.645653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.645934 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.646201 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.658459 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.665167 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.665775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.666051 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.666318 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.666964 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:21.667353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.668637 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.668734 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.684195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 276/553] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:21.684445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:21.685332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:21.686838 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:21.686838 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:21.686838 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:21.687088 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.687160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 278/554] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:21.687160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.696594 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.787814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23e873-4841-4c5c-9d89-31f53631224a None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.794163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47d13-bd21-4afc-afdd-4c1a75059a99 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.802528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.822047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.822765 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.823204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.823479 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.829567 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.830188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.830454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.830730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.834425 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.835938 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.841771 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.843669 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:21.851928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:21.853084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:21.853984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:21.853984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:21.853984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:21.853984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 279/555] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:21.853984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:21.861668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:21.862947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:21.863846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:21.863846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:21.863846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:21.863846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 277/556] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:21.863846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.915518 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:21.961700 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8084e15-7a84-4500-a79d-f248c35e2b10 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.971757 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed139f97-a8d3-439e-bb1c-8a86ecf01fc2 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.999953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.000621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.000877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.001145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.008720 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.009330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.009601 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.009782 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.009868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.010498 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:22.010800 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.011279 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.012189 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:22.023590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:22.025383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 280/557] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:22.028133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.029713 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 278/558] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:22.031285 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.052417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.132325 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885e76a-68db-47e4-b7b0-cee25f923643 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.135858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80f084-2a7c-4023-897d-c42fd36a361f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.149036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.166928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.167554 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.167829 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.168102 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.168752 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:22.169061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.169152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.169748 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.170016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.170283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.170478 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.170912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:22.171240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.172589 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.181976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 281/559] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:22.182884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.189297 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 279/560] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:22.189297 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.265420 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.283244 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dba7e9-9477-435f-87a8-c6d27f92adfc None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.288375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebcaba-6f9e-4300-88a3-bba79513d338 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.324174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.324789 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.325065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.325347 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.326058 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:22.326372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.328301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.336127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.336781 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.337057 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.337329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.346557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.348152 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.354245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 280/561] 10.222.0.69 () {56 vars in 1137 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:22.354917 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:22.364222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:22.365296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:22.366237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 282/562] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:22.366817 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.406724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.458328 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f728255-0d3b-44b5-a309-2bad8968792f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.468244 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de70445-6ba1-4acf-b01b-17391b8ebaa1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.492314 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.492948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.493223 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.493486 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.496177 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.501262 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.501889 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.502136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.502278 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.502423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.503962 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.509567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.511067 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:22.518336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:22.519504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:22.520447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 281/563] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:22.521021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:22.522610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:22.528685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 283/564] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:22.530173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.619564 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.623525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b90e53-1d35-4d86-a18a-57792f6c07b7 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.623892 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ada4e9-ff3b-4dcf-8286-16ffb4f39a21 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.656132 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.656731 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.657002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.657268 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.657362 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.657935 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.658024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:22.658211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.658310 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.658542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.659737 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.668907 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.670457 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.676927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 284/565] 10.222.0.69 () {56 vars in 1137 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:22.677743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:22.684222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:22.685224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:22.686182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:22.686182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:22.686182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:22.686182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 282/566] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:22.686182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.733729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.784997 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9475b-3f1b-40b5-984b-c7cc1fab86c7 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.788932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ce1b-9468-4335-8216-960e9061efbc None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.819267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.819870 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.820203 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.820411 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.821162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:22.821425 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.822860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.823018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.823630 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.823908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.824181 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.824871 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:22.825176 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.826646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.838677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 283/567] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:22.839406 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.844666 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 285/568] 10.222.0.69 () {56 vars in 1139 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:22.844666 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:22.861267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.941784 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748cc6f-cf80-4439-8a3b-e11b9ead1f57 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.946658 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0627556-1eea-443a-8030-50f377ccf200 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:22.951639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:22.978148 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.978770 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.979072 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.979341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.982442 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:22.983143 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:22.983422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:22.983694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:22.984341 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:22.984651 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.986026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.989662 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:22.991122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:22.997342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 286/569] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:22.998230 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:23.006529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:23.007632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:23.008515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:23.008515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:23.008515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:23.008515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 284/570] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:23.008515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.075474 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:23.101242 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1982c-327b-4bf2-88b9-ef54216941e5 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.111507 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ddf09-7df4-4504-a8d4-525d56ac8385 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.134595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27254-d5f9-496c-bee9-864022cd3120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.135282 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27254-d5f9-496c-bee9-864022cd3120 None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.135553 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27254-d5f9-496c-bee9-864022cd3120 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.135795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27254-d5f9-496c-bee9-864022cd3120 None admin] PATH_INFO: `/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/c27846f3ffc54cbcb0131c160d19c754/roles/b306a250d1614c329f4ac8c9b6dfbc58` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.147262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.147888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.148159 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.148429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.150358 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb27254-d5f9-496c-bee9-864022cd3120 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fce45fd90438a989865dcdda638f9, user_id=c27846f3ffc54cbcb0131c160d19c754, role_id=b306a250d1614c329f4ac8c9b6dfbc58)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.151828 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb27254-d5f9-496c-bee9-864022cd3120 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.160045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.161504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.165039 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 287/571] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:27:22 2022] PUT /identity/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/c27846f3ffc54cbcb0131c160d19c754/roles/b306a250d1614c329f4ac8c9b6dfbc58 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:27:23.165874 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27254-d5f9-496c-bee9-864022cd3120 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:23.177264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:23.178386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:23.179355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:23.179355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:23.179355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:23.179355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 285/572] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:23.179591 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:23.286675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb27254-d5f9-496c-bee9-864022cd3120 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.304637 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6428cf1-8b03-4e10-ae87-617341b04865 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.314261 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:23.329482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.330193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.330473 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.330773 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.338388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.339929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.344262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.344881 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.345154 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.345420 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.346065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:23.346367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.347861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:23.352917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:23.353843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 288/573] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:23.355449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.369301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 286/574] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:23.369974 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.441294 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:23.476137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae93ae-a972-40ce-8eec-29b5750eb366 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.485987 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18af0-db94-41ff-a4fb-83e35d8d8389 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.512726 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.513424 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.513763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.514048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.514815 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:23.515156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.516680 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.531930 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.532897 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.533353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.533837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.534676 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 287/575] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:23.535347 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:23.535627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.536021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.537561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.550577 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 289/576] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:23.556174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.605963 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:23.643989 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0e966-d8c3-4588-8d5b-32d637571f46 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.663970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5365b-1fe3-4f2d-a4eb-b3e73d4061d6 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.678479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:23.684607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.685243 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.685518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.685892 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.700052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.701553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.705958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c896f-df2f-4ec5-a880-6c1a0a46aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.706620 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c896f-df2f-4ec5-a880-6c1a0a46aeee None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.706913 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c896f-df2f-4ec5-a880-6c1a0a46aeee None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.707211 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c896f-df2f-4ec5-a880-6c1a0a46aeee None admin] PATH_INFO: `/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/3eb9db2887ee4e81aee4a4e2228f0add/roles/b306a250d1614c329f4ac8c9b6dfbc58` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:23.728783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:23.729910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:23.730988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:23.730988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:23.730988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:23.730988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:23.730988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:23.730988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:23.730988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:23.730988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:23.732903 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c896f-df2f-4ec5-a880-6c1a0a46aeee None admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fce45fd90438a989865dcdda638f9, user_id=3eb9db2887ee4e81aee4a4e2228f0add, role_id=b306a250d1614c329f4ac8c9b6dfbc58)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.734663 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c896f-df2f-4ec5-a880-6c1a0a46aeee None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.734771 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 288/577] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:23.735542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.749686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 290/578] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:27:23 2022] PUT /identity/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/3eb9db2887ee4e81aee4a4e2228f0add/roles/b306a250d1614c329f4ac8c9b6dfbc58 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:27:23.751167 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c896f-df2f-4ec5-a880-6c1a0a46aeee None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.862528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa437de4-1ebe-4c66-a8ff-6956c68fe8b8 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.893061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:23.903546 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.903774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c896f-df2f-4ec5-a880-6c1a0a46aeee None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:23.904654 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.905067 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.905469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.913149 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.914860 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:23.931302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:23.932450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:23.933610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:23.933610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:23.933610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:23.933610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:23.933610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:23.933610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:23.933610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:23.933610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:23.940775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 289/579] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:23.943950 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:23.955418 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:23.956299 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:23.956988 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:23.957412 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:23.958299 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:23.958739 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:23.960345 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:23.981755 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 291/580] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:23.989415 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:24.008983 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:24.068168 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9b17-79c3-41ac-8359-c72fb921d0fc None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:24.104338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec79d23-13ab-472b-a4fd-940a06d30e7f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:24.109318 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:24.110043 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:24.110418 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:24.110786 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:24.111635 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:24.112045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:24.113648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:24.130017 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 290/581] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:24.135455 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:24.150760 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eb004-8815-47c2-badf-7fe42068b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:24.152014 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb004-8815-47c2-badf-7fe42068b51e None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:24.152283 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb004-8815-47c2-badf-7fe42068b51e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:24.152617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb004-8815-47c2-badf-7fe42068b51e None admin] PATH_INFO: `/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/5c679a1bdee541f2830dce7ee89e60f5/roles/b306a250d1614c329f4ac8c9b6dfbc58` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:24.174003 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eb004-8815-47c2-badf-7fe42068b51e None admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fce45fd90438a989865dcdda638f9, user_id=5c679a1bdee541f2830dce7ee89e60f5, role_id=b306a250d1614c329f4ac8c9b6dfbc58)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:24.175511 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eb004-8815-47c2-badf-7fe42068b51e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:24.191778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 292/582] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:27:23 2022] PUT /identity/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/5c679a1bdee541f2830dce7ee89e60f5/roles/b306a250d1614c329f4ac8c9b6dfbc58 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:27:24.255934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bbe93-bcde-421a-9792-611fabe6cdfb None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:24.274502 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:24.300200 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20d7e8-5749-4b24-968c-0cae1f0a91ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:24.301150 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20d7e8-5749-4b24-968c-0cae1f0a91ff None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:24.301525 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20d7e8-5749-4b24-968c-0cae1f0a91ff None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:24.301923 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20d7e8-5749-4b24-968c-0cae1f0a91ff None admin] PATH_INFO: `/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/69dafc33dd0d4f85822f8d54af542ee3/roles/b306a250d1614c329f4ac8c9b6dfbc58` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:24.320130 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20d7e8-5749-4b24-968c-0cae1f0a91ff None admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fce45fd90438a989865dcdda638f9, user_id=69dafc33dd0d4f85822f8d54af542ee3, role_id=b306a250d1614c329f4ac8c9b6dfbc58)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:24.321755 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20d7e8-5749-4b24-968c-0cae1f0a91ff None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:24.338874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 291/583] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:27:24 2022] PUT /identity/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/69dafc33dd0d4f85822f8d54af542ee3/roles/b306a250d1614c329f4ac8c9b6dfbc58 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:27:25.424346 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3bf64-0ba4-4ec3-b45b-4b0ff48edbfc None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:25.424949 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3bf64-0ba4-4ec3-b45b-4b0ff48edbfc None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:25.424949 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3bf64-0ba4-4ec3-b45b-4b0ff48edbfc None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:25.427271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 293/584] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:25.432836 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6547e1-5bab-4590-9ab0-551ca4e274ae None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:25.433295 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6547e1-5bab-4590-9ab0-551ca4e274ae None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:25.433391 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6547e1-5bab-4590-9ab0-551ca4e274ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:25.451948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-3c6547e1-5bab-4590-9ab0-551ca4e274ae None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:25.453334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-3c6547e1-5bab-4590-9ab0-551ca4e274ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:25.530038 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 292/585] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:25.859484 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3bf64-0ba4-4ec3-b45b-4b0ff48edbfc None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:25.863926 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:25.968426 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3bf64-0ba4-4ec3-b45b-4b0ff48edbfc None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:26.003858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a1c5-3e14-48c4-a773-b05940b4a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:26.004491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a1c5-3e14-48c4-a773-b05940b4a458 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.004759 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a1c5-3e14-48c4-a773-b05940b4a458 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.005021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a1c5-3e14-48c4-a773-b05940b4a458 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.013060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c541a2-2d8e-4536-a1bd-511e50fad667 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.013352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c541a2-2d8e-4536-a1bd-511e50fad667 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.013613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c541a2-2d8e-4536-a1bd-511e50fad667 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.015324 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 293/586] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:26.016523 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26a1c5-3e14-48c4-a773-b05940b4a458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:26.020340 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c589-4f80-4534-811a-6c5b4ee17c55 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.020621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c589-4f80-4534-811a-6c5b4ee17c55 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.020893 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c589-4f80-4534-811a-6c5b4ee17c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-6c26a1c5-3e14-48c4-a773-b05940b4a458 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:26.021811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:26.022770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:26.023699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:26.027105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 294/587] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:26.029200 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a1c5-3e14-48c4-a773-b05940b4a458 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:26.042826 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-29c5c589-4f80-4534-811a-6c5b4ee17c55 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:26.044081 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-29c5c589-4f80-4534-811a-6c5b4ee17c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:26.093802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:26.123372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 294/588] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:26.133002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a1c5-3e14-48c4-a773-b05940b4a458 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:26.167929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:26.168529 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.168799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.169064 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.169816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:26.170115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:26.171638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:26.185512 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 295/589] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:26.187415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c589-4f80-4534-811a-6c5b4ee17c55 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:26.223797 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:26.290658 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c589-4f80-4534-811a-6c5b4ee17c55 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:26.324975 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:26.325609 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.325888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.326155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.337491 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:26.338951 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:26.355112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:26.356127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:26.357021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:26.357021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:26.357021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:26.361382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 295/590] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:26.363298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:26.461882 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:26.479505 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f507f-57c3-4ee9-b532-dde5eb0c92cf None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:26.505901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:26.516030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35532a-a736-4d51-bcff-b4f74b2eff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:26.516632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35532a-a736-4d51-bcff-b4f74b2eff78 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.516902 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35532a-a736-4d51-bcff-b4f74b2eff78 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.517166 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35532a-a736-4d51-bcff-b4f74b2eff78 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.517807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35532a-a736-4d51-bcff-b4f74b2eff78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:26.518113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35532a-a736-4d51-bcff-b4f74b2eff78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:26.519516 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35532a-a736-4d51-bcff-b4f74b2eff78 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:26.538180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 296/591] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:26.538180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285571b-eb57-4717-8a3c-44a0bf46fa39 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.538180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285571b-eb57-4717-8a3c-44a0bf46fa39 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.538180 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285571b-eb57-4717-8a3c-44a0bf46fa39 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.543087 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 297/592] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:26.543087 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285571b-eb57-4717-8a3c-44a0bf46fa39 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:26.563838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:26.595343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d2e54-6d1a-407a-ae7c-eeec0495771d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:26.629343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0df28e-9cc8-478f-bc5d-c0ea31ce25e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:26.629949 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0df28e-9cc8-478f-bc5d-c0ea31ce25e1 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.630215 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0df28e-9cc8-478f-bc5d-c0ea31ce25e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.630479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0df28e-9cc8-478f-bc5d-c0ea31ce25e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.640367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0df28e-9cc8-478f-bc5d-c0ea31ce25e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-de0df28e-9cc8-478f-bc5d-c0ea31ce25e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:26.645730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:26.651355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 296/593] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:26.652268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb83e6-f9e3-4efc-8ec6-5ac92e40e42b None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.653037 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb83e6-f9e3-4efc-8ec6-5ac92e40e42b None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.653111 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285571b-eb57-4717-8a3c-44a0bf46fa39 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:26.653191 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb83e6-f9e3-4efc-8ec6-5ac92e40e42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.665928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-5dcb83e6-f9e3-4efc-8ec6-5ac92e40e42b None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:26.667145 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-5dcb83e6-f9e3-4efc-8ec6-5ac92e40e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:26.684763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe39da-142e-4c01-b281-f7985d966c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:26.685501 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe39da-142e-4c01-b281-f7985d966c43 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.685900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe39da-142e-4c01-b281-f7985d966c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.686235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe39da-142e-4c01-b281-f7985d966c43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.693558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe39da-142e-4c01-b281-f7985d966c43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:26.695117 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe39da-142e-4c01-b281-f7985d966c43 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-7cfe39da-142e-4c01-b281-f7985d966c43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:26.706332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:26.707645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 298/594] 10.222.0.69 () {56 vars in 1093 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:26.708596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359eb6a-5b68-48c4-be6d-b4f7e0a124fe None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.709277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359eb6a-5b68-48c4-be6d-b4f7e0a124fe None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.709277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359eb6a-5b68-48c4-be6d-b4f7e0a124fe None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.710281 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 299/595] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:26.710957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359eb6a-5b68-48c4-be6d-b4f7e0a124fe None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:26.741233 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 297/596] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:26.742079 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb83e6-f9e3-4efc-8ec6-5ac92e40e42b None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:26.766085 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:26.816477 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:26.827515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359eb6a-5b68-48c4-be6d-b4f7e0a124fe None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:26.856077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb83e6-f9e3-4efc-8ec6-5ac92e40e42b None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:26.865863 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eec57-3a9f-4f20-be3b-814b21dc51d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:26.866469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eec57-3a9f-4f20-be3b-814b21dc51d5 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.866889 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eec57-3a9f-4f20-be3b-814b21dc51d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.867169 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eec57-3a9f-4f20-be3b-814b21dc51d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.867837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eec57-3a9f-4f20-be3b-814b21dc51d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:26.868138 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eec57-3a9f-4f20-be3b-814b21dc51d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:26.869631 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eec57-3a9f-4f20-be3b-814b21dc51d5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:26.883240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 300/597] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:26.883240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620746-5ad1-40c0-adc7-39914c1139ab None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.883240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620746-5ad1-40c0-adc7-39914c1139ab None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.883240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620746-5ad1-40c0-adc7-39914c1139ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.895603 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:26.896218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:26.896584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:26.896850 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:26.897631 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:26.897928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:26.898819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-91620746-5ad1-40c0-adc7-39914c1139ab None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:26.899456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:26.900337 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-91620746-5ad1-40c0-adc7-39914c1139ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:26.917284 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 298/598] 10.222.0.69 () {56 vars in 1133 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:26.918186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:26.974511 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 301/599] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:26.976059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620746-5ad1-40c0-adc7-39914c1139ab None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.022603 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98ce52-b6fc-4ba3-9d5c-e95e1763e786 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.035726 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.047312 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.061069 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.061703 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.061977 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.062251 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.072869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.074284 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:27.089469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:27.090446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:27.091360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:27.091360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:27.091360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:27.091360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 299/600] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:27.091897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.105060 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620746-5ad1-40c0-adc7-39914c1139ab None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.145726 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de7ef-3fb1-487c-a2c7-f1ca8b58f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.146343 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de7ef-3fb1-487c-a2c7-f1ca8b58f09f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.146619 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de7ef-3fb1-487c-a2c7-f1ca8b58f09f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.146895 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de7ef-3fb1-487c-a2c7-f1ca8b58f09f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.223483 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94de7ef-3fb1-487c-a2c7-f1ca8b58f09f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.224288 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1bd09-3464-43de-952f-deedc36a7616 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.224947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94de7ef-3fb1-487c-a2c7-f1ca8b58f09f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.261146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40b4f5-9a77-468c-acb6-4e9ce4504332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.261942 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40b4f5-9a77-468c-acb6-4e9ce4504332 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.266661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40b4f5-9a77-468c-acb6-4e9ce4504332 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.266949 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40b4f5-9a77-468c-acb6-4e9ce4504332 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.268033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.278901 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40b4f5-9a77-468c-acb6-4e9ce4504332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-2b40b4f5-9a77-468c-acb6-4e9ce4504332 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:27.284234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:27.285137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 300/601] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:27.286101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40b4f5-9a77-468c-acb6-4e9ce4504332 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.321819 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.338657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 302/602] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:27.339747 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de7ef-3fb1-487c-a2c7-f1ca8b58f09f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.394981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40b4f5-9a77-468c-acb6-4e9ce4504332 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.428699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.429323 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.429573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.429850 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.430487 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:27.430769 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.432179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.443253 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 301/603] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:27.445883 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de7ef-3fb1-487c-a2c7-f1ca8b58f09f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.448010 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.480322 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.480921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.481207 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.481467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.482135 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:27.482432 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.483919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.489099 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.492793 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 303/604] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:27.493954 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.551473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.560047 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fed36d-fc22-4f69-8723-51805aca1ad2 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.596151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db3fac-95f4-40b4-8d48-3f0249aea058 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.596716 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56482f9-8588-44cf-b3f6-12699c6aa695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.597351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56482f9-8588-44cf-b3f6-12699c6aa695 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.597626 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56482f9-8588-44cf-b3f6-12699c6aa695 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.597897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56482f9-8588-44cf-b3f6-12699c6aa695 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.608399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56482f9-8588-44cf-b3f6-12699c6aa695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-d56482f9-8588-44cf-b3f6-12699c6aa695 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:27.613442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:27.614409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:27.615280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 302/605] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:27.615980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56482f9-8588-44cf-b3f6-12699c6aa695 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.633510 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.634139 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.634409 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.634672 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.645316 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.646763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:27.660088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:27.661023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:27.661918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:27.661918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:27.661918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:27.661918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 304/606] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:27.662139 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.714558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.723162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56482f9-8588-44cf-b3f6-12699c6aa695 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.755544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.756160 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.756430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.756693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] PATH_INFO: `/v3/users/glance` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.761496 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c057554-0b39-42f3-be23-182ed410ae9d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.764397 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.765839 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:27.777222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:27.778214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:27.779198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 303/607] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:27.783691 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.795816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.796450 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.796728 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.797029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.799411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.807686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.809129 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:27.822538 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:27.823627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:27.824526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:27.824526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:27.824526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:27.824526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 305/608] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:27.824526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.889569 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def6347-760f-49cf-9a95-8a38c673d9be None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.925179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.925892 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.926144 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520945-fa62-4704-ae38-5cd19a523fd1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:27.926248 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.926413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.927110 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] RBAC: Adding query filter params (name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:27.927408 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.928504 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:27.928782 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.937129 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 304/609] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:27.937857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:27.960972 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:27.961577 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:27.961855 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:27.962136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:27.962782 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:27.963122 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:27.964490 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:27.976382 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 306/610] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:27.977252 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.012763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.036421 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef287e-f105-4621-b19b-626da6de7a10 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.068910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.069508 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.069792 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.070019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.070765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:28.071091 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.072518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.073835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e7a6f-2c0f-4fef-9bcf-74a1ff125447 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.089591 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 305/611] 10.222.0.69 () {56 vars in 1137 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:28.090392 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.112341 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.113064 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.113198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.113477 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.114124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:28.114425 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.115820 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.127613 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 307/612] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:28.128415 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.154637 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.187822 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152c97-2d78-4e80-9d5d-8bdaa3a5ce2f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.222770 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.223378 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.223655 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.223915 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.225808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.229861 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498465c-502d-43cc-a07f-a3ff7374dc99 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.235404 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.236857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:28.251174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:28.252262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:28.253653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:28.253653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:28.253653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:28.253653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 306/613] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:28.253653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.268051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.268676 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.268948 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.269220 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.275897 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.277344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:28.288816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:28.289761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:28.290660 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 308/614] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:28.291223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.351537 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edf847-994a-480a-b29f-4a71de5d9979 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.376214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.385435 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff329fc6-6c6f-4173-b6b9-2eb92f1fc13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.386042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff329fc6-6c6f-4173-b6b9-2eb92f1fc13b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.386316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff329fc6-6c6f-4173-b6b9-2eb92f1fc13b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.386585 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff329fc6-6c6f-4173-b6b9-2eb92f1fc13b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.392246 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416d674-4593-42d5-99a4-635633a3305d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.425948 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.426413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.426697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.426970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.434356 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.435877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.439861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:28.447546 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:28.448525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 309/615] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:28.449469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.458527 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff329fc6-6c6f-4173-b6b9-2eb92f1fc13b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.460255 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff329fc6-6c6f-4173-b6b9-2eb92f1fc13b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.554439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373890f-6b87-4b32-91a8-0d07ccf523f2 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.561552 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 307/616] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:28.562426 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff329fc6-6c6f-4173-b6b9-2eb92f1fc13b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.589078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.589686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.589964 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.590229 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.590867 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:28.591211 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.592611 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.604549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 310/617] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:28.605177 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.610077 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.647312 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.662083 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff329fc6-6c6f-4173-b6b9-2eb92f1fc13b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.694887 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.695446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.695721 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.695995 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.696685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:28.696994 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.698435 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.704525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb95fa-2c4e-4281-8d3c-b0bf375fcfb2 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.710236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 308/618] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:28.711033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.744051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.744655 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.744926 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.745187 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.745903 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:28.746199 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.747652 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.764700 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 311/619] 10.222.0.69 () {56 vars in 1137 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:28.768112 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.811674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02a654-00a1-4b7b-b944-142403567395 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.827182 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.845488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.846132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.846402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.846662 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.857492 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.858951 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.864900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdfcc7-338c-436c-80f2-ab97249805dd None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:28.865172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:28.873256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:28.874517 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:28.875521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:28.875521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:28.875521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:28.875521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 309/620] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:28.875753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.900425 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:28.901040 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:28.901313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:28.901581 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:28.908752 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:28.910193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:28.922058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:28.923468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 312/621] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:28.924762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:28.978399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185c6be-7dbb-414a-b2ce-659f44a37bb5 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.011569 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.012169 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.012420 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.012695 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.013409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=c27846f3ffc54cbcb0131c160d19c754) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:29.013714 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.015242 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.021084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 310/622] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/role_assignments?user.id=c27846f3ffc54cbcb0131c160d19c754&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:29.021944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.024997 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513a4c0-50e8-438a-b886-a7666a491939 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.051549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:29.070831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a4a0e-06df-4c73-9067-0d473aa31b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.071564 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a4a0e-06df-4c73-9067-0d473aa31b56 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.071839 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a4a0e-06df-4c73-9067-0d473aa31b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.072111 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a4a0e-06df-4c73-9067-0d473aa31b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.115477 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:29.149331 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a4a0e-06df-4c73-9067-0d473aa31b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.150853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a4a0e-06df-4c73-9067-0d473aa31b56 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.167760 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c2461-0ebc-4dd3-ab7d-ec87e1539728 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.214696 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.215361 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.215617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.215888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.216534 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:29.216834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.218617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.233616 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 311/623] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:29.234383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.275681 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 313/624] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:29.275681 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a4a0e-06df-4c73-9067-0d473aa31b56 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.300095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:29.347718 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749d902-765a-4d0e-8178-503e81a55934 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.370464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:29.381823 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a4a0e-06df-4c73-9067-0d473aa31b56 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.383217 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.383894 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.384180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.384451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.385205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:29.385509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.386940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.406981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 312/625] 10.222.0.69 () {56 vars in 1139 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:29.407852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.423972 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.424646 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.424924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.425189 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.432290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.433732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:29.445361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:29.446284 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:29.447217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 314/626] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:29.447737 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.521536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586b0cf-9512-4024-8b75-ef16780eaf8e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.536612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:29.557398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41d472-9110-42c9-9a4f-8c24594792cf None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.562147 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.562777 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.563081 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.563355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.574136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.575864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:29.590592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:29.591614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:29.592609 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:29.592609 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:29.592609 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:29.592609 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 313/627] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:29.593190 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.602287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f43e0-7ce5-4776-bcc5-9403ce777856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.603350 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f43e0-7ce5-4776-bcc5-9403ce777856 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.603631 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f43e0-7ce5-4776-bcc5-9403ce777856 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.603899 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f43e0-7ce5-4776-bcc5-9403ce777856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.627740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:29.675446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f43e0-7ce5-4776-bcc5-9403ce777856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.677044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f43e0-7ce5-4776-bcc5-9403ce777856 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.699759 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d8fb-8fa6-4657-8e51-d55d1d5ed900 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.734547 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.735197 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.735471 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.735739 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.736429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:29.736729 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.738223 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.750625 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 314/628] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:29.751569 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.770906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:29.796367 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 315/629] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:29.797147 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f43e0-7ce5-4776-bcc5-9403ce777856 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.854629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:29.865015 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae5b8d-c8c6-4a40-a8d7-09929b90b824 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.902081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f43e0-7ce5-4776-bcc5-9403ce777856 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:29.905163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.905848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.906129 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.906402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.907080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:29.907384 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.908886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.923042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 315/630] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:29.923515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:29.948157 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:29.949090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:29.949583 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:29.949849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:29.950578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=3eb9db2887ee4e81aee4a4e2228f0add) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:29.950880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:29.952555 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:29.971081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 316/631] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/role_assignments?user.id=3eb9db2887ee4e81aee4a4e2228f0add&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:29.971081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:30.028294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:30.057355 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e16cb6-dd8b-408e-a97a-8387071d20cd None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:30.098819 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:30.099670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:30.100010 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:30.100353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:30.101686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef722e-6ec4-4c76-9fcf-5c94b3a9c683 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:30.113705 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:30.115634 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:30.136096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:30.137097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:30.138012 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:30.138012 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:30.138012 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:30.138012 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 316/632] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:30.144153 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:30.148150 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:30.149732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:30.150592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:30.151071 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:30.151512 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:30.160252 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:30.162225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:30.178884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:30.180033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:30.180924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 317/633] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:30.186193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:30.271260 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc91ba-3b72-4bd6-8a07-bef135326633 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:30.308854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79d17-ab0c-4426-b375-c19f41eb282e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:30.316502 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:30.317098 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:30.318081 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:30.318465 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:30.318688 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:30.319429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:30.319803 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:30.321659 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:30.343205 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 317/634] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:30.347844 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:30.350116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:30.351054 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:30.352307 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:30.352647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:30.353442 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:30.353749 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:30.355243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:30.372133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 318/635] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:30.377939 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:30.421329 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:30.466761 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b11448-bc42-41bd-a386-c3d3d16cb370 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:30.500654 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e948d-dfb2-4079-a30f-61903551a06e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:30.507675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:30.508533 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:30.508900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:30.509263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:30.516991 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:30.518645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:30.530683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:30.531628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:30.532544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 318/636] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:30.537564 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:30.538940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:30.539576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:30.539847 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:30.540391 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:30.542056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=5c679a1bdee541f2830dce7ee89e60f5) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:30.542366 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:30.543893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:30.559198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 319/637] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:30 2022] GET /identity/v3/role_assignments?user.id=5c679a1bdee541f2830dce7ee89e60f5&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:30.657157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddd43-f79a-4e68-b3a2-edd5b1676fee None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:30.684045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:30.697105 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d797211-0c89-480f-a45b-b3375c594af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:30.697728 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d797211-0c89-480f-a45b-b3375c594af3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:30.697999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d797211-0c89-480f-a45b-b3375c594af3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:30.698269 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d797211-0c89-480f-a45b-b3375c594af3 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:30.698989 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d797211-0c89-480f-a45b-b3375c594af3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:30.699304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d797211-0c89-480f-a45b-b3375c594af3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:30.700768 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d797211-0c89-480f-a45b-b3375c594af3 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:30.714984 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 319/638] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:30.721693 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:30.756877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:30.842575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531497-16cd-4f99-8cb7-6e8bb448a73e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:30.879456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0905bc-39af-415d-824b-44e19ce2a0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:30.880065 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0905bc-39af-415d-824b-44e19ce2a0ab None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:30.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0905bc-39af-415d-824b-44e19ce2a0ab None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:30.880602 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0905bc-39af-415d-824b-44e19ce2a0ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:30.881430 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0905bc-39af-415d-824b-44e19ce2a0ab None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=69dafc33dd0d4f85822f8d54af542ee3) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:30.881732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0905bc-39af-415d-824b-44e19ce2a0ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:30.883220 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0905bc-39af-415d-824b-44e19ce2a0ab None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:30.890256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 320/639] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:30 2022] GET /identity/v3/role_assignments?user.id=69dafc33dd0d4f85822f8d54af542ee3&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:31.417908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ab12-7a40-4dbc-97c6-3979cba80573 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:31.418330 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ab12-7a40-4dbc-97c6-3979cba80573 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:31.418515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ab12-7a40-4dbc-97c6-3979cba80573 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:31.420061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 320/640] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:31.425516 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408b866-3d83-48ea-99f2-b9e9465261d5 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:31.425874 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408b866-3d83-48ea-99f2-b9e9465261d5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:31.426212 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408b866-3d83-48ea-99f2-b9e9465261d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:31.444662 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-4408b866-3d83-48ea-99f2-b9e9465261d5 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:31.445851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-4408b866-3d83-48ea-99f2-b9e9465261d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:31.513425 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 321/641] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:31.848385 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7ab12-7a40-4dbc-97c6-3979cba80573 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:31.955819 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7ab12-7a40-4dbc-97c6-3979cba80573 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:32.118061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016eab0-b8e3-4743-bad0-a92e0f42eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:32.119019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016eab0-b8e3-4743-bad0-a92e0f42eef7 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:32.119473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016eab0-b8e3-4743-bad0-a92e0f42eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:32.119939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016eab0-b8e3-4743-bad0-a92e0f42eef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:32.130747 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016eab0-b8e3-4743-bad0-a92e0f42eef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-2016eab0-b8e3-4743-bad0-a92e0f42eef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:32.135832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:32.136824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:32.137724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:32.140073 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 321/642] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:27:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:32.147667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408b866-3d83-48ea-99f2-b9e9465261d5 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:32.172198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:32.257942 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408b866-3d83-48ea-99f2-b9e9465261d5 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:32.298193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d14a58-ee0f-43d9-8a04-4efcd309bbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:32.298803 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14a58-ee0f-43d9-8a04-4efcd309bbcc None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:32.299108 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14a58-ee0f-43d9-8a04-4efcd309bbcc None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:32.299466 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d14a58-ee0f-43d9-8a04-4efcd309bbcc None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:32.300189 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d14a58-ee0f-43d9-8a04-4efcd309bbcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:32.300493 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d14a58-ee0f-43d9-8a04-4efcd309bbcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:32.301879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d14a58-ee0f-43d9-8a04-4efcd309bbcc None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:32.314571 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 322/643] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:32.320058 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016eab0-b8e3-4743-bad0-a92e0f42eef7 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:32.367266 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee303e-aa45-4c5e-9b8a-9480a4750efc None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:32.367648 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee303e-aa45-4c5e-9b8a-9480a4750efc None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:32.367981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee303e-aa45-4c5e-9b8a-9480a4750efc None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:32.369920 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 323/644] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:32.375164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:32.376235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea268-74b9-4051-a64e-68454cdec012 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:32.376521 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea268-74b9-4051-a64e-68454cdec012 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:32.376786 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea268-74b9-4051-a64e-68454cdec012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:32.395071 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-4c7ea268-74b9-4051-a64e-68454cdec012 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:32.396256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-4c7ea268-74b9-4051-a64e-68454cdec012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:32.440778 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016eab0-b8e3-4743-bad0-a92e0f42eef7 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:32.477319 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:32.478171 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:32.478280 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:32.478563 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:32.489843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 324/645] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:32.493917 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:32.496363 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:32.512102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:32.513141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:32.514075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:32.514075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:32.514075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:32.516186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 322/646] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:32.521520 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ea268-74b9-4051-a64e-68454cdec012 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:32.540431 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:32.632695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ea268-74b9-4051-a64e-68454cdec012 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:32.667683 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:32.668294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:32.668567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:32.668831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:32.669545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:32.669839 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:32.671283 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:32.683625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 325/647] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:32.688981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:32.790028 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:32.796299 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f993-5319-46e6-a6fb-2d27dddc2e8b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:32.829263 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:32.838016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:32.838677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:32.838942 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:32.839241 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:32.851184 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:32.852666 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:32.869279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:32.870292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:32.871274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 323/648] 10.222.0.69 () {56 vars in 1093 bytes} [Fri Aug 19 02:27:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:32.880061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:32.935499 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:32.944490 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2b4c-fb8c-4b85-9aa0-63f639c88926 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:32.982147 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:32.982888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:32.983223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:32.983496 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] PATH_INFO: `/v3/services/image` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:32.984102 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:32.985555 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:32.987204 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6331bb-75f4-49d5-a4d9-5bb28085a2f0 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:32.997591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:32.998783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:32.999776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:33.003945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 326/649] 10.222.0.69 () {56 vars in 1105 bytes} [Fri Aug 19 02:27:32 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:33.005016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.027469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50107222-c5cc-48e9-ba11-4a528c0b6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:33.028235 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50107222-c5cc-48e9-ba11-4a528c0b6124 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.028597 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50107222-c5cc-48e9-ba11-4a528c0b6124 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.028956 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50107222-c5cc-48e9-ba11-4a528c0b6124 None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.029879 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50107222-c5cc-48e9-ba11-4a528c0b6124 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:33.030270 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50107222-c5cc-48e9-ba11-4a528c0b6124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:33.031845 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50107222-c5cc-48e9-ba11-4a528c0b6124 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:33.049693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 324/650] 10.222.0.69 () {56 vars in 1133 bytes} [Fri Aug 19 02:27:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:33.051014 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcc9e1-1472-438e-8058-760b9ad954cc None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.051512 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcc9e1-1472-438e-8058-760b9ad954cc None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.051911 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcc9e1-1472-438e-8058-760b9ad954cc None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.053362 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 325/651] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:33.059955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcc9e1-1472-438e-8058-760b9ad954cc None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.077094 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:33.114711 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d55e-f1e0-40c2-b668-7d2d74ad3f9e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:33.149693 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedea20-143a-4552-b06e-ed1f4b5213d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:33.150374 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedea20-143a-4552-b06e-ed1f4b5213d8 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.150589 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedea20-143a-4552-b06e-ed1f4b5213d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.150854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedea20-143a-4552-b06e-ed1f4b5213d8 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.151522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedea20-143a-4552-b06e-ed1f4b5213d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:33.151815 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedea20-143a-4552-b06e-ed1f4b5213d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:33.153192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedea20-143a-4552-b06e-ed1f4b5213d8 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:33.157822 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 327/652] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:33.158946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93996-9d61-4036-93f7-f15b5f462306 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.159266 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93996-9d61-4036-93f7-f15b5f462306 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.159539 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93996-9d61-4036-93f7-f15b5f462306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.166326 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:33.168588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcc9e1-1472-438e-8058-760b9ad954cc None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:33.177536 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-16c93996-9d61-4036-93f7-f15b5f462306 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:33.178758 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-16c93996-9d61-4036-93f7-f15b5f462306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:33.203300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8288152-5013-4590-8860-ffcee15e5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:33.203845 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288152-5013-4590-8860-ffcee15e5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.204111 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288152-5013-4590-8860-ffcee15e5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.204368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288152-5013-4590-8860-ffcee15e5ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.242915 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 328/653] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:33.244286 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5f0f-2b5c-4724-9d23-7d1537ea6725 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.244563 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5f0f-2b5c-4724-9d23-7d1537ea6725 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.244828 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5f0f-2b5c-4724-9d23-7d1537ea6725 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.246030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 329/654] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:33.246701 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f5f0f-2b5c-4724-9d23-7d1537ea6725 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.285725 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8288152-5013-4590-8860-ffcee15e5ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:33.287262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8288152-5013-4590-8860-ffcee15e5ff9 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:33.304137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:33.374958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f5f0f-2b5c-4724-9d23-7d1537ea6725 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:33.393624 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 326/655] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:27:33.394952 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a18a-15ff-4959-8866-305efa0eed41 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.395267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a18a-15ff-4959-8866-305efa0eed41 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.395540 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a18a-15ff-4959-8866-305efa0eed41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.414130 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-9c01a18a-15ff-4959-8866-305efa0eed41 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:33.415469 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-9c01a18a-15ff-4959-8866-305efa0eed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:33.417697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:33.419024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.419024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.419024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.419515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] RBAC: Adding query filter params (type=image) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:33.419810 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:33.421228 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:33.422808 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:33.435391 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 330/656] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:33.436456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.504102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 327/657] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:33.563523 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e22a25-8d71-48cb-903a-da81dfa0572c None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:33.563896 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a18a-15ff-4959-8866-305efa0eed41 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.615467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:33.616591 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:33.617205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.618033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.618481 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.630409 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:33.632328 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:33.651447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:33.652452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:33.653584 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:33.653584 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:33.653584 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:33.653584 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 331/658] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:33.658004 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.697458 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a18a-15ff-4959-8866-305efa0eed41 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:33.709984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:33.740757 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:33.741507 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.741869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.742208 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.743402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:33.744859 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:33.758375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:33.759483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:33.760833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 328/659] 10.222.0.69 () {56 vars in 1129 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:33.765317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.789836 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10fd4b-ca50-4585-a210-ab9471e81c21 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:33.826548 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:33.827252 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.827533 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.827812 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.828470 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:33.828818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:33.830258 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:33.844801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 332/660] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:33.845544 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.896450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e1b9c-03ab-497a-aee2-b2c9ae6db002 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:33.905354 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:33.935271 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:33.935999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:33.936270 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:33.936530 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:33.937151 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:33.937473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:33.938839 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:33.950840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 329/661] 10.222.0.69 () {56 vars in 1124 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:33.950840 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:33.961247 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9d5df-f66d-4313-a8e7-5b962c109d45 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:33.976862 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:34.005000 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:34.005712 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:34.005901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:34.006166 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] PATH_INFO: `/v3/services/network` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:34.006756 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:34.008176 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:34.017150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:34.018124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:34.019042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 333/662] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:34.019997 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:34.067644 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca4e0-6e78-4b55-9031-1b90e91d5e07 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:34.103704 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:34.104321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:34.104634 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:34.104889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:34.111717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:34.113341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:34.124752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:34.125864 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 330/663] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:34.126762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:34.132991 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc9c82-f2db-483e-bade-eca7c8adb0dd None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:34.161460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:34.171967 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:34.173125 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:34.173579 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:34.174011 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:34.174914 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:34.175254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:34.176824 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:34.181638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 334/664] 10.222.0.69 () {56 vars in 1124 bytes} [Fri Aug 19 02:27:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:34.184222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:34.232093 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:34.250623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa7e71-de61-405c-a09d-169c711a954f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:34.288437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:34.289019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:34.289362 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:34.289717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:34.290442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] RBAC: Adding query filter params (name=network) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:34.290909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:34.292357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:34.298352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 331/665] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:27:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:34.303743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdbe04-4268-4fe6-bf87-ebd8378f2b1f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:34.308656 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:34.346357 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:34.346987 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:34.347294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:34.347567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:34.348301 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:34.348615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:34.350100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:34.368667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 335/666] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:34.369650 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:34.433072 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:34.440182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40812b-851e-4aee-bf3f-32d7d066ed0a None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:34.480594 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64a839-e878-4705-8a81-fa4cde0e0f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:34.481515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64a839-e878-4705-8a81-fa4cde0e0f3e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:34.481967 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64a839-e878-4705-8a81-fa4cde0e0f3e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:34.482552 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64a839-e878-4705-8a81-fa4cde0e0f3e None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:34.483482 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64a839-e878-4705-8a81-fa4cde0e0f3e None admin] RBAC: Adding query filter params (type=network) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:34.484042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64a839-e878-4705-8a81-fa4cde0e0f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:34.485631 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64a839-e878-4705-8a81-fa4cde0e0f3e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:34.487843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:34.499027 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5c13-c53a-492d-82b5-481423295306 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:34.499511 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 332/667] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:27:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:34.534266 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000cc4-7b0c-4c47-92f7-f5912772d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:34.535023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000cc4-7b0c-4c47-92f7-f5912772d0da None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:34.535467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000cc4-7b0c-4c47-92f7-f5912772d0da None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:34.535748 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000cc4-7b0c-4c47-92f7-f5912772d0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:34.536574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000cc4-7b0c-4c47-92f7-f5912772d0da None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=c27846f3ffc54cbcb0131c160d19c754) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:34.536877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000cc4-7b0c-4c47-92f7-f5912772d0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:34.538417 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000cc4-7b0c-4c47-92f7-f5912772d0da None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:34.545950 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 336/668] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:34 2022] GET /identity/v3/role_assignments?user.id=c27846f3ffc54cbcb0131c160d19c754&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=22d22ddee1804d668628115534a289ab => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:35.679056 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159f2e-8d6f-4249-b84e-285941aaafdc None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:35.679958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159f2e-8d6f-4249-b84e-285941aaafdc None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:35.680214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159f2e-8d6f-4249-b84e-285941aaafdc None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:35.684170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 333/669] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:35.694602 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183083-1e1b-4251-b7b2-599baeb1f27e None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:35.695124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183083-1e1b-4251-b7b2-599baeb1f27e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:35.695225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183083-1e1b-4251-b7b2-599baeb1f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:35.713647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-39183083-1e1b-4251-b7b2-599baeb1f27e None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:35.714832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-39183083-1e1b-4251-b7b2-599baeb1f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:35.784647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 337/670] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:36.125499 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d159f2e-8d6f-4249-b84e-285941aaafdc None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:36.232518 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d159f2e-8d6f-4249-b84e-285941aaafdc None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:36.267573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ea5a1-6b61-4ddc-b33b-1fe8ea605052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:36.268193 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea5a1-6b61-4ddc-b33b-1fe8ea605052 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:36.268464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea5a1-6b61-4ddc-b33b-1fe8ea605052 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:36.268733 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea5a1-6b61-4ddc-b33b-1fe8ea605052 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:36.269401 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ea5a1-6b61-4ddc-b33b-1fe8ea605052 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:36.270879 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ea5a1-6b61-4ddc-b33b-1fe8ea605052 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:36.298646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 334/671] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:27:36 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:36.457166 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971ba4-4c22-4cbd-a80d-136048497d0b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:36.457351 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971ba4-4c22-4cbd-a80d-136048497d0b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:36.457612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971ba4-4c22-4cbd-a80d-136048497d0b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:36.459248 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 338/672] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:36.465244 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8a060-bf29-4d59-ba17-40f84bc40593 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:36.465575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8a060-bf29-4d59-ba17-40f84bc40593 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:36.465799 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8a060-bf29-4d59-ba17-40f84bc40593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:36.486314 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-53c8a060-bf29-4d59-ba17-40f84bc40593 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:36.487593 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-53c8a060-bf29-4d59-ba17-40f84bc40593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:36.503576 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:36.566103 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 335/673] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:36 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:36.779460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d49aee-c7a4-405d-9613-5c31b9860cee None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:36.780401 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d49aee-c7a4-405d-9613-5c31b9860cee None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:36.780874 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d49aee-c7a4-405d-9613-5c31b9860cee None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:36.782645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 339/674] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:36.787452 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e87e9f-8192-44ae-9ae2-f5926163a809 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:36.787878 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e87e9f-8192-44ae-9ae2-f5926163a809 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:36.787974 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e87e9f-8192-44ae-9ae2-f5926163a809 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:36.788373 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f98b96-4d66-45b6-80c4-29caa5b12949 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:36.788876 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f98b96-4d66-45b6-80c4-29caa5b12949 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:36.789357 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f98b96-4d66-45b6-80c4-29caa5b12949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:36.789542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 336/675] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:36.794389 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2d83c-f23a-4a75-a0c2-e41acbc14a53 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:36.794808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2d83c-f23a-4a75-a0c2-e41acbc14a53 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:36.795115 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2d83c-f23a-4a75-a0c2-e41acbc14a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:36.811420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-d3f98b96-4d66-45b6-80c4-29caa5b12949 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:36.812936 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-d3f98b96-4d66-45b6-80c4-29caa5b12949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:36.815209 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-2fc2d83c-f23a-4a75-a0c2-e41acbc14a53 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:36.817010 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-2fc2d83c-f23a-4a75-a0c2-e41acbc14a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:36.899176 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 337/676] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:36 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:27:36.900080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2d83c-f23a-4a75-a0c2-e41acbc14a53 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:36.900767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 340/677] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:36 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:27:36.982075 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:37.007049 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2d83c-f23a-4a75-a0c2-e41acbc14a53 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:37.046243 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4adfb-ea05-4f41-9100-1c77d9744da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:37.047245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4adfb-ea05-4f41-9100-1c77d9744da9 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:37.047738 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4adfb-ea05-4f41-9100-1c77d9744da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:37.048203 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4adfb-ea05-4f41-9100-1c77d9744da9 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:37.049056 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4adfb-ea05-4f41-9100-1c77d9744da9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:37.050621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4adfb-ea05-4f41-9100-1c77d9744da9 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:37.068371 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 338/678] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:27:36 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:37.231608 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f98b96-4d66-45b6-80c4-29caa5b12949 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:37.259529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4adfb-ea05-4f41-9100-1c77d9744da9 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:37.278370 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:37.378173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f98b96-4d66-45b6-80c4-29caa5b12949 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:37.389155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4adfb-ea05-4f41-9100-1c77d9744da9 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:37.420725 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:37.426531 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae6565-8fdb-4761-b63e-ea420b1d3729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:37.427551 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae6565-8fdb-4761-b63e-ea420b1d3729 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:37.427671 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7070f52-892d-4341-9bed-b0caf270d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:37.427957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae6565-8fdb-4761-b63e-ea420b1d3729 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:37.428300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae6565-8fdb-4761-b63e-ea420b1d3729 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:37.428788 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7070f52-892d-4341-9bed-b0caf270d4cc None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:37.429105 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae6565-8fdb-4761-b63e-ea420b1d3729 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:37.429816 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7070f52-892d-4341-9bed-b0caf270d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:37.430308 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7070f52-892d-4341-9bed-b0caf270d4cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:37.431335 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae6565-8fdb-4761-b63e-ea420b1d3729 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:37.443699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7070f52-892d-4341-9bed-b0caf270d4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:37.452756 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 339/679] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:27:37 2022] POST /identity/v3/services => generated 240 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-a7070f52-892d-4341-9bed-b0caf270d4cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:37.452951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:37.454175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:37.455196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 341/680] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:37.463048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae6565-8fdb-4761-b63e-ea420b1d3729 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:37.586067 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae6565-8fdb-4761-b63e-ea420b1d3729 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:37.624025 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:37.624653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:37.624920 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:37.625187 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:37.625871 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:37.626167 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:37.627607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:37.639242 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 340/681] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:37.643544 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7070f52-892d-4341-9bed-b0caf270d4cc None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:37.734031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:37.754485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7070f52-892d-4341-9bed-b0caf270d4cc None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:37.798774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:37.799460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:37.799706 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:37.799958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:37.810514 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:37.812179 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:37.827208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:37.828164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:37.829462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:37.829462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:37.829462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:37.829462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 342/682] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:37.834260 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:37.886963 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:37.945268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775e9fd-0eae-44a0-ada7-5fd21b3c6650 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:37.980508 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:37.981122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:37.981399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:37.981669 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:37.982312 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:37.982612 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:37.984060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:37.996782 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 341/683] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:38.002377 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:38.113444 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9763f9-821b-4f38-9f53-f875464d534d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:38.149991 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:38.150627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:38.150902 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:38.151220 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:38.153140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:38.160535 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:38.162012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:38.174522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:38.175519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:38.177095 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 343/684] 10.222.0.69 () {56 vars in 1093 bytes} [Fri Aug 19 02:27:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:38.181705 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:38.286036 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049770c4-ab85-4ebb-bf7d-edb5fa639020 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:38.297164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:38.321097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:38.321756 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:38.322039 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:38.322306 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:38.323061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:38.323369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:38.324798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:38.343409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 342/685] 10.222.0.69 () {56 vars in 1133 bytes} [Fri Aug 19 02:27:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:38.352430 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:38.466643 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edb7f-21c0-45bd-8e61-6a1fd5ca5c1b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:38.502600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cd41f-6813-4d8d-8b39-e669fe82cebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:38.503640 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd41f-6813-4d8d-8b39-e669fe82cebc None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:38.504141 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd41f-6813-4d8d-8b39-e669fe82cebc None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:38.504605 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd41f-6813-4d8d-8b39-e669fe82cebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:38.516867 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cd41f-6813-4d8d-8b39-e669fe82cebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:38.518638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cd41f-6813-4d8d-8b39-e669fe82cebc None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-db0cd41f-6813-4d8d-8b39-e669fe82cebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:38.534378 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:38.535406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:38.536360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:38.536360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:38.536360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:38.538464 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 344/686] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:38.544620 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:38.590670 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f84b-309c-4ed3-8066-8fe85e4c8e1b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:38.591320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f84b-309c-4ed3-8066-8fe85e4c8e1b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:38.591817 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f84b-309c-4ed3-8066-8fe85e4c8e1b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:38.593757 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 345/687] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:38.598783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30cac-fe02-4e35-87d7-772894e60a3c None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:38.599328 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30cac-fe02-4e35-87d7-772894e60a3c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:38.599815 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30cac-fe02-4e35-87d7-772894e60a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:38.619860 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-1bd30cac-fe02-4e35-87d7-772894e60a3c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:38.621448 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-1bd30cac-fe02-4e35-87d7-772894e60a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:38.654821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834645-ba5d-4504-a3a5-f08cb4e54303 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:38.669021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:38.690445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:38.691086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:38.691362 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:38.691637 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:38.692367 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:38.692674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:38.694045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:38.699629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 346/688] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:27:38.711044 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 343/689] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:38.713274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30cac-fe02-4e35-87d7-772894e60a3c None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:38.824195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30cac-fe02-4e35-87d7-772894e60a3c None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:38.860621 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:38.861567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:38.862017 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:38.862484 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:38.869795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:38.871465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:38.882953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:38.883927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:38.884827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:38.884827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:38.884827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:38.884827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:38.884827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:38.884827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:38.884827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:38.884827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:38.891089 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 347/690] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:38.893023 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:38.923412 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:38.996284 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998af35-d993-4f79-bd20-3d9822917a5c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:39.025465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:39.034100 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:39.035639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.036070 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.036485 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.037338 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:39.038211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:39.040513 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:39.063257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 344/691] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:39.068936 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:39.072244 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:39.145574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d1b5a-c5a4-4d79-b20e-8c64a8435bda None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:39.188137 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:39.188772 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.189049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.189525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.190048 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:39.191571 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:39.198209 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:39.201443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:39.202735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:39.203657 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:39.207383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 348/692] 10.222.0.69 () {56 vars in 1105 bytes} [Fri Aug 19 02:27:39 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:39.209404 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:39.217578 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d628d-6745-4551-8218-60fb7708ed24 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:39.261642 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd8a45-6914-4f78-a4c3-f390bab651ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:39.262316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8a45-6914-4f78-a4c3-f390bab651ca None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.262589 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8a45-6914-4f78-a4c3-f390bab651ca None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.262857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8a45-6914-4f78-a4c3-f390bab651ca None admin] PATH_INFO: `/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/c27846f3ffc54cbcb0131c160d19c754/roles/22d22ddee1804d668628115534a289ab` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.265536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd8a45-6914-4f78-a4c3-f390bab651ca None admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fce45fd90438a989865dcdda638f9, user_id=c27846f3ffc54cbcb0131c160d19c754, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:39.267049 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd8a45-6914-4f78-a4c3-f390bab651ca None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:39.295445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 345/693] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:27:39 2022] PUT /identity/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/c27846f3ffc54cbcb0131c160d19c754/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:27:39.347320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:39.352619 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1bc66-9470-47d0-bf13-c1e2c5a781d9 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:39.396365 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e935d-d76a-4b91-b5d2-6096b142c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:39.397360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e935d-d76a-4b91-b5d2-6096b142c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.397851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e935d-d76a-4b91-b5d2-6096b142c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.398394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e935d-d76a-4b91-b5d2-6096b142c9f0 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.399412 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e935d-d76a-4b91-b5d2-6096b142c9f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:39.399925 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e935d-d76a-4b91-b5d2-6096b142c9f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:39.401556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e935d-d76a-4b91-b5d2-6096b142c9f0 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:39.408651 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 349/694] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:39.415210 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd8a45-6914-4f78-a4c3-f390bab651ca None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:39.519707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27572e12-45aa-42a7-99e6-524e3ef4a186 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.520381 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27572e12-45aa-42a7-99e6-524e3ef4a186 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.520875 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27572e12-45aa-42a7-99e6-524e3ef4a186 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.522704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 350/695] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:39.529605 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88059-ae40-48df-8e64-10662dbee163 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.529797 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88059-ae40-48df-8e64-10662dbee163 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.530016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88059-ae40-48df-8e64-10662dbee163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.548787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd8a45-6914-4f78-a4c3-f390bab651ca None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:39.551477 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-12b88059-ae40-48df-8e64-10662dbee163 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:39.552662 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-12b88059-ae40-48df-8e64-10662dbee163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:39.584956 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:39.585739 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.586065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.586341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.586982 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:39.587320 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:39.588703 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:39.595101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 346/696] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:39.601164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:39.620272 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:39.636304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 351/697] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:27:39.715089 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa06774-6ac5-427a-acc7-e0957c2612d3 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:39.755419 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f8fe2-18cc-4cad-b368-6f5af4457268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:39.756423 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f8fe2-18cc-4cad-b368-6f5af4457268 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.756896 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f8fe2-18cc-4cad-b368-6f5af4457268 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.757376 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f8fe2-18cc-4cad-b368-6f5af4457268 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.758332 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f8fe2-18cc-4cad-b368-6f5af4457268 None admin] RBAC: Adding query filter params (interface=public, service_id=6bc580015e5141de9c5ec0ec93ab49dc, region_id=RegionOne) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:39.758833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f8fe2-18cc-4cad-b368-6f5af4457268 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:39.760447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f8fe2-18cc-4cad-b368-6f5af4457268 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:39.770233 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 347/698] 10.222.0.69 () {56 vars in 1251 bytes} [Fri Aug 19 02:27:39 2022] GET /identity/v3/endpoints?service_id=6bc580015e5141de9c5ec0ec93ab49dc&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:39.780539 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88059-ae40-48df-8e64-10662dbee163 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:39.884665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:39.892914 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88059-ae40-48df-8e64-10662dbee163 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:39.898032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd294e36-8ccf-4ca1-9dc1-0a1058b328bb None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.898872 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd294e36-8ccf-4ca1-9dc1-0a1058b328bb None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.899387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd294e36-8ccf-4ca1-9dc1-0a1058b328bb None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.901132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 348/699] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:39.909965 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6f4d5-ab51-4125-b8a6-2116078ed778 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.910739 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6f4d5-ab51-4125-b8a6-2116078ed778 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.911305 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6f4d5-ab51-4125-b8a6-2116078ed778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.931187 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-68d6f4d5-ab51-4125-b8a6-2116078ed778 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:39.932571 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50fde8-8bf7-4127-8a0f-755ac3190e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:39.933083 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-68d6f4d5-ab51-4125-b8a6-2116078ed778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:39.933190 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50fde8-8bf7-4127-8a0f-755ac3190e25 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:39.933452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50fde8-8bf7-4127-8a0f-755ac3190e25 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:39.933716 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50fde8-8bf7-4127-8a0f-755ac3190e25 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:39.934389 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50fde8-8bf7-4127-8a0f-755ac3190e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:39.935832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50fde8-8bf7-4127-8a0f-755ac3190e25 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:39.942214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 352/700] 10.222.0.69 () {56 vars in 1087 bytes} [Fri Aug 19 02:27:39 2022] GET /identity/v3/services => generated 1002 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:27:40.000344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50fde8-8bf7-4127-8a0f-755ac3190e25 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.018558 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 349/701] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:27:40.112789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50fde8-8bf7-4127-8a0f-755ac3190e25 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:40.150662 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:40.151335 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:40.151610 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:40.151880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:40.152464 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:40.153835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:40.162891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:40.163908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:40.164771 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 353/702] 10.222.0.69 () {56 vars in 1129 bytes} [Fri Aug 19 02:27:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:40.171155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6f4d5-ab51-4125-b8a6-2116078ed778 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.181321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:40.288665 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6f4d5-ab51-4125-b8a6-2116078ed778 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:40.324829 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:40.325862 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:40.326329 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:40.327026 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:40.328031 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:40.328546 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:40.330098 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:40.335879 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 350/703] 10.222.0.69 () {56 vars in 1124 bytes} [Fri Aug 19 02:27:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:40.347019 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.350767 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.383406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:40.423918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:40.448060 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51442b24-7cb1-4ebf-9b73-a53c913e293e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:40.458238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df1bf5-2c04-4443-9f55-379d5f641917 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:40.484688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:40.485301 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:40.485581 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:40.485992 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:40.486469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:40.486770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:40.488197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:40.493707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 354/704] 10.222.0.69 () {56 vars in 1124 bytes} [Fri Aug 19 02:27:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:40.497225 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:40.498026 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:40.498502 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:40.499140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] PATH_INFO: `/v3/services/network` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:40.499579 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.500014 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:40.501533 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:40.511539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:40.512806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:40.513891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:40.516389 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 351/705] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:40 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:40.522731 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.599847 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:40.621406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c1855-e37b-482d-9506-959528c5de89 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:40.644722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45440e-104f-456b-9b15-ea6e12db653c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:40.667649 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:40.668858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:40.669701 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:40.670450 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:40.671630 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] RBAC: Adding query filter params (interface=public, service_id=fbe942e2e88c4d3b95b1ee065d7056b6, region_id=RegionOne) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:40.672544 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:40.674602 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:40.680870 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:40.681478 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:40.681842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:40.682136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:40.682740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:40.683082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:40.684662 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:40.685096 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 355/706] 10.222.0.69 () {56 vars in 1251 bytes} [Fri Aug 19 02:27:40 2022] GET /identity/v3/endpoints?service_id=fbe942e2e88c4d3b95b1ee065d7056b6&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:40.690380 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:40.692614 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.696200 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 352/707] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:27:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:40.703977 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.795530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc0ce-1445-46ca-8373-432ee69553cb None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:40.807295 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97923004-ecbe-4b1b-9436-dc15ce5403c6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:40.829309 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a240221-a9ff-4885-90c3-b5d8f646a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:40.830262 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a240221-a9ff-4885-90c3-b5d8f646a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:40.830728 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a240221-a9ff-4885-90c3-b5d8f646a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:40.831222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a240221-a9ff-4885-90c3-b5d8f646a4e1 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:40.832135 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a240221-a9ff-4885-90c3-b5d8f646a4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:40.833713 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a240221-a9ff-4885-90c3-b5d8f646a4e1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:40.839722 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 356/708] 10.222.0.69 () {56 vars in 1087 bytes} [Fri Aug 19 02:27:40 2022] GET /identity/v3/services => generated 1002 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:27:40.851110 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:40.851110 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:40.851110 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:40.851110 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:40.851519 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] RBAC: Adding query filter params (type=network) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:40.851519 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:40.851519 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:40.852798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 353/709] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:27:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:40.859122 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a240221-a9ff-4885-90c3-b5d8f646a4e1 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:40.879413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:40.977563 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a240221-a9ff-4885-90c3-b5d8f646a4e1 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:41.017718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e469e3-e925-454a-be37-4c0bc1f1b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:41.018749 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e469e3-e925-454a-be37-4c0bc1f1b839 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:41.019398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e469e3-e925-454a-be37-4c0bc1f1b839 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:41.019901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e469e3-e925-454a-be37-4c0bc1f1b839 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:41.020813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e469e3-e925-454a-be37-4c0bc1f1b839 None admin] RBAC: Adding query filter params (interface=public, service_id=424b473dad734ac7894211ace61d06a7, region_id=RegionOne) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:41.021314 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e469e3-e925-454a-be37-4c0bc1f1b839 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:41.022891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e469e3-e925-454a-be37-4c0bc1f1b839 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:41.029633 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 357/710] 10.222.0.69 () {56 vars in 1251 bytes} [Fri Aug 19 02:27:40 2022] GET /identity/v3/endpoints?service_id=424b473dad734ac7894211ace61d06a7&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:41.035329 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:41.104159 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:41.145779 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f295364-96f7-4765-9bf7-b15a746d90c6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:41.182566 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a74a-5e01-4f0b-b5e3-c0c1f81d2ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:41.183221 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a74a-5e01-4f0b-b5e3-c0c1f81d2ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:41.183504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a74a-5e01-4f0b-b5e3-c0c1f81d2ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:41.183776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a74a-5e01-4f0b-b5e3-c0c1f81d2ae5 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:41.184386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a74a-5e01-4f0b-b5e3-c0c1f81d2ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:41.185767 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a74a-5e01-4f0b-b5e3-c0c1f81d2ae5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:41.192151 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 354/711] 10.222.0.69 () {56 vars in 1087 bytes} [Fri Aug 19 02:27:41 2022] GET /identity/v3/services => generated 1002 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:27:41.626269 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c59d6-7975-46dc-a74f-31262dd09479 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:41.626707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c59d6-7975-46dc-a74f-31262dd09479 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:41.626811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c59d6-7975-46dc-a74f-31262dd09479 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:41.628481 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 358/712] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:41.633816 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4045c2-4cdb-4580-84ea-9424a37340d7 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:41.634102 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4045c2-4cdb-4580-84ea-9424a37340d7 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:41.634383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4045c2-4cdb-4580-84ea-9424a37340d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:41.652524 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-af4045c2-4cdb-4580-84ea-9424a37340d7 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:41.653721 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-af4045c2-4cdb-4580-84ea-9424a37340d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:41.722704 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 355/713] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:42.052046 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c59d6-7975-46dc-a74f-31262dd09479 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:42.150864 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:42.176790 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c59d6-7975-46dc-a74f-31262dd09479 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:42.224221 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9b87e-91cf-47c5-aecd-2f8d80ec4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:42.225566 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b87e-91cf-47c5-aecd-2f8d80ec4fbb None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:42.226034 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b87e-91cf-47c5-aecd-2f8d80ec4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:42.226653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b87e-91cf-47c5-aecd-2f8d80ec4fbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:42.240767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9b87e-91cf-47c5-aecd-2f8d80ec4fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-e8f9b87e-91cf-47c5-aecd-2f8d80ec4fbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:27:42.246568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:42.247791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:27:42.248947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:42.251424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 359/714] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:42.264472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4045c2-4cdb-4580-84ea-9424a37340d7 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:42.326733 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:42.381628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4045c2-4cdb-4580-84ea-9424a37340d7 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:42.391540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51948-5aaa-4e02-95f5-fcbb101c45f0 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:42.391821 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51948-5aaa-4e02-95f5-fcbb101c45f0 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:42.392099 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51948-5aaa-4e02-95f5-fcbb101c45f0 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:42.393691 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 360/715] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:42.398867 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1006ad1-c693-4d8b-a409-de43483c76a9 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:42.399184 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1006ad1-c693-4d8b-a409-de43483c76a9 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:42.399454 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1006ad1-c693-4d8b-a409-de43483c76a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:42.418501 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:42.419138 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:42.419421 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:42.419528 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-c1006ad1-c693-4d8b-a409-de43483c76a9 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:42.419690 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:42.420416 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:42.420719 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:42.420888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-c1006ad1-c693-4d8b-a409-de43483c76a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:42.422110 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:42.431635 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 356/716] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:42.438332 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:42.513743 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 361/717] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:27:42.566433 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512eea25-5928-45bd-bee4-63e20af0bcff None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:42.588123 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:42.603477 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:42.604352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:42.604630 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:42.604906 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:42.619156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:42.620619 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:42.635852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:42.638062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:42.640283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:42.640283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:42.640283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:42.640283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 357/718] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:42.643921 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1006ad1-c693-4d8b-a409-de43483c76a9 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:42.714729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:42.749506 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1006ad1-c693-4d8b-a409-de43483c76a9 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:42.785101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:42.785718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:42.785994 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:42.786261 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:42.786970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:42.787306 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:42.788756 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:42.801345 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 362/719] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:42.806719 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:42.861263 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:42.915470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73c8e9-6fc3-4948-aa81-06cd6b3d65e1 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:42.954867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:42.955651 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:42.955921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:42.956188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:42.964677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:42.966123 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:27:42.979042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:42.980085 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:27:42.981060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:42.985088 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 358/720] 10.222.0.69 () {56 vars in 1093 bytes} [Fri Aug 19 02:27:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:42.986073 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.001542 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00313550-2b56-449f-8c86-4c9ec002abae None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:43.022266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:43.048821 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:43.059753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:43.061246 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.061664 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.062071 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] PATH_INFO: `/v3/services/image` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.062895 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:43.064530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:43.074078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:43.075386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:27:43.076324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:43.078740 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 363/721] 10.222.0.69 () {56 vars in 1105 bytes} [Fri Aug 19 02:27:42 2022] GET /identity/v3/services/image => generated 86 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:43.084819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.109620 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e84ee7-a176-49d2-a3aa-0ff9308102ce None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:43.148155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:43.148682 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.149265 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.149383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.150096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:43.150477 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:43.151893 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:43.176479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 359/722] 10.222.0.69 () {56 vars in 1133 bytes} [Fri Aug 19 02:27:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:43.178054 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.213815 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36b917-42fd-44d7-a1b5-ba6d63574fd8 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:43.256447 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0ca9-d7fc-4d3d-9ca8-e8c4b108bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:43.257255 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0ca9-d7fc-4d3d-9ca8-e8c4b108bc90 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.257665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0ca9-d7fc-4d3d-9ca8-e8c4b108bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.258115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0ca9-d7fc-4d3d-9ca8-e8c4b108bc90 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.258900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0ca9-d7fc-4d3d-9ca8-e8c4b108bc90 None admin] RBAC: Adding query filter params (name=image) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:43.259433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0ca9-d7fc-4d3d-9ca8-e8c4b108bc90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:43.261249 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0ca9-d7fc-4d3d-9ca8-e8c4b108bc90 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:43.266959 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 364/723] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:43.269140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dee645-7ee6-46ce-8cf0-7c206c7e115e None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.269604 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dee645-7ee6-46ce-8cf0-7c206c7e115e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.270062 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dee645-7ee6-46ce-8cf0-7c206c7e115e None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.272591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 365/724] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:43.277526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dee645-7ee6-46ce-8cf0-7c206c7e115e None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.287252 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:43.304599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4348db-4fcc-4bc2-8fe2-64a526a0c87c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:43.343470 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:43.346473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406177c-11f0-4ae7-a233-3da266e2e72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:43.346473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406177c-11f0-4ae7-a233-3da266e2e72b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.346723 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406177c-11f0-4ae7-a233-3da266e2e72b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.346939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406177c-11f0-4ae7-a233-3da266e2e72b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.397003 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dee645-7ee6-46ce-8cf0-7c206c7e115e None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:43.422884 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406177c-11f0-4ae7-a233-3da266e2e72b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:43.424357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406177c-11f0-4ae7-a233-3da266e2e72b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:43.433905 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28393a00-312d-48a5-a073-7d438e12c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:43.434777 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393a00-312d-48a5-a073-7d438e12c6db None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.435303 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393a00-312d-48a5-a073-7d438e12c6db None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.435612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393a00-312d-48a5-a073-7d438e12c6db None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.436395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28393a00-312d-48a5-a073-7d438e12c6db None admin] RBAC: Adding query filter params (type=image) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:43.436944 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28393a00-312d-48a5-a073-7d438e12c6db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:43.438067 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28393a00-312d-48a5-a073-7d438e12c6db None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:43.447970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 366/725] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:43.447970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227af1c-7db2-4aa8-a0fc-53e2ac638485 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.447970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227af1c-7db2-4aa8-a0fc-53e2ac638485 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.447970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227af1c-7db2-4aa8-a0fc-53e2ac638485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.464343 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-9227af1c-7db2-4aa8-a0fc-53e2ac638485 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:43.465548 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-9227af1c-7db2-4aa8-a0fc-53e2ac638485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:43.527081 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:43.535155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 367/726] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:43 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:43.536315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227af1c-7db2-4aa8-a0fc-53e2ac638485 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.541499 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 360/727] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:43 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:27:43.542752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1dca-0eec-4528-9ca3-e22491303140 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.543059 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1dca-0eec-4528-9ca3-e22491303140 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.543336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1dca-0eec-4528-9ca3-e22491303140 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.548599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 361/728] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:43.548599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1dca-0eec-4528-9ca3-e22491303140 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.595457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:43.646573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227af1c-7db2-4aa8-a0fc-53e2ac638485 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:43.657639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1dca-0eec-4528-9ca3-e22491303140 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:43.682440 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731b9bd-a837-4bab-979d-c3a31da8fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:43.683114 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b9bd-a837-4bab-979d-c3a31da8fa90 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.683389 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b9bd-a837-4bab-979d-c3a31da8fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.683763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b9bd-a837-4bab-979d-c3a31da8fa90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.684410 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731b9bd-a837-4bab-979d-c3a31da8fa90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:43.686045 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731b9bd-a837-4bab-979d-c3a31da8fa90 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:43.694163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:43.694792 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.695112 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.695387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.707101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:43.708544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:43.719043 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 368/729] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:27:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:43.719043 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44dea-5a68-4659-a749-71e6977d5ca9 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.719043 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44dea-5a68-4659-a749-71e6977d5ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.719043 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44dea-5a68-4659-a749-71e6977d5ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:43.729080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:43.730196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:43.731155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:43.731155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:43.731155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:43.731155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 362/730] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:43.736143 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.738708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-bba44dea-5a68-4659-a749-71e6977d5ca9 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:43.740081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-bba44dea-5a68-4659-a749-71e6977d5ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:43.800866 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:43.833513 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 369/731] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:43 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:43.872693 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba44dea-5a68-4659-a749-71e6977d5ca9 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.873273 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cd1ff-5b6f-4bd1-9e8f-2fd008a3c9c2 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:43.911638 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:43.916780 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:43.917399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:43.917669 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:43.917946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:43.918607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:43.918980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:43.920445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:43.936694 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 363/732] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:43.942577 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:43.998195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba44dea-5a68-4659-a749-71e6977d5ca9 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.038342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.039030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.039617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.039617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.040214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.041774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:44.051413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:44.052424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:44.053271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 370/733] 10.222.0.69 () {56 vars in 1129 bytes} [Fri Aug 19 02:27:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:44.058763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.067348 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:44.071940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ebb56-3648-4ad2-b289-ae1652fe0058 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.119494 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.120512 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.120976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.121435 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.131962 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.133420 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:27:44.145640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:44.146587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:44.147535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:27:44.147535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:27:44.147535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:27:44.147535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:27:44.147535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:27:44.147535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:27:44.147535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:27:44.147535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:44.151647 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 364/734] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:44.152936 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.186240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:44.193252 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b6807-d8b6-492c-bdb5-6d8501ec6922 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.228958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.229563 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.229837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.230106 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.230736 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:44.231063 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.232432 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.237350 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 371/735] 10.222.0.69 () {56 vars in 1124 bytes} [Fri Aug 19 02:27:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:44.242548 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.262555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099fdcf-7617-415c-aa77-6168383a0253 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.302589 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.303934 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.304360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.304809 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.305705 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:44.306208 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.307684 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.324632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 365/736] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:44.324632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.348168 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:44.349287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f98c4-99d8-4a53-bac0-268040c2a0cd None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.382387 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.383045 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.383325 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.383592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] PATH_INFO: `/v3/services/network` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.384166 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.385527 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:44.394289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:44.395342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:44.396194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 372/737] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:44 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:44.397049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.425740 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:44.438693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769e9e-a33c-4140-b3d7-f850f7caf86e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.472317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.472855 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.473132 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.473401 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.474028 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:44.474335 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.475730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.480643 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 366/738] 10.222.0.69 () {56 vars in 1124 bytes} [Fri Aug 19 02:27:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:44.481435 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.514026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199a17c-5c15-4b36-811d-c17c697ea29e None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.550213 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.551047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.551262 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.551403 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.552167 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=c27846f3ffc54cbcb0131c160d19c754) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:44.552471 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.553902 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.567028 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 373/739] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:27:44 2022] GET /identity/v3/role_assignments?user.id=c27846f3ffc54cbcb0131c160d19c754&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=22d22ddee1804d668628115534a289ab => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:44.567028 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.582294 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:44.602717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59524-cd3d-474c-ae19-3f169248834c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.643244 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.643847 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.644123 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.644655 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.646301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] RBAC: Adding query filter params (name=network) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:44.646631 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.648092 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.654787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 367/740] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:27:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:44.660899 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.672049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:44.688844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf326-8854-4df0-8f91-67350838e040 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.728846 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d48219-999f-47bf-ab29-739373f6e196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.729530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d48219-999f-47bf-ab29-739373f6e196 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.729904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d48219-999f-47bf-ab29-739373f6e196 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.730359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d48219-999f-47bf-ab29-739373f6e196 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.731200 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d48219-999f-47bf-ab29-739373f6e196 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.732830 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d48219-999f-47bf-ab29-739373f6e196 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.757667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 374/741] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:27:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:44.810544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86de59-a5e7-4bb7-b1e7-68d3b8660e70 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:44.857812 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c0ec0-840d-449b-9567-08ccd3329f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:44.858440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0ec0-840d-449b-9567-08ccd3329f9a None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:44.858801 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0ec0-840d-449b-9567-08ccd3329f9a None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:44.859067 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0ec0-840d-449b-9567-08ccd3329f9a None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:44.859762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c0ec0-840d-449b-9567-08ccd3329f9a None admin] RBAC: Adding query filter params (type=network) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:44.860067 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c0ec0-840d-449b-9567-08ccd3329f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:44.861552 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c0ec0-840d-449b-9567-08ccd3329f9a None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:44.867736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 368/742] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:27:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:44.873448 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d48219-999f-47bf-ab29-739373f6e196 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:44.984962 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d48219-999f-47bf-ab29-739373f6e196 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:45.019176 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf08f79-c4bc-41e4-bedc-a8164593c650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:45.020128 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf08f79-c4bc-41e4-bedc-a8164593c650 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:45.020580 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf08f79-c4bc-41e4-bedc-a8164593c650 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:45.021020 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf08f79-c4bc-41e4-bedc-a8164593c650 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:45.021846 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf08f79-c4bc-41e4-bedc-a8164593c650 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:45.023469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf08f79-c4bc-41e4-bedc-a8164593c650 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:45.040647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:45.046398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 375/743] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:27:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:27:46.019069 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aace6-edf8-4adb-8c6d-823d6bddbf43 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:46.019811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aace6-edf8-4adb-8c6d-823d6bddbf43 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:46.019811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aace6-edf8-4adb-8c6d-823d6bddbf43 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:46.020946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 369/744] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:27:46.026849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218ff3-efd2-4368-a17e-7b200dd3440f None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:46.027360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218ff3-efd2-4368-a17e-7b200dd3440f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:46.027433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218ff3-efd2-4368-a17e-7b200dd3440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:46.045773 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-f2218ff3-efd2-4368-a17e-7b200dd3440f None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:46.046938 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-f2218ff3-efd2-4368-a17e-7b200dd3440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:46.143145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 376/745] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:46 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:46.470824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aace6-edf8-4adb-8c6d-823d6bddbf43 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:46.482913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:46.598958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aace6-edf8-4adb-8c6d-823d6bddbf43 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:46.643912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987889a0-3dbb-4564-88a9-555e8a1b2e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:46.644680 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987889a0-3dbb-4564-88a9-555e8a1b2e68 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:46.645042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987889a0-3dbb-4564-88a9-555e8a1b2e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:46.645341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987889a0-3dbb-4564-88a9-555e8a1b2e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:46.727914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987889a0-3dbb-4564-88a9-555e8a1b2e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:46.729543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987889a0-3dbb-4564-88a9-555e8a1b2e68 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:46.741825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:46.859301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 370/746] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:27:46 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:27:46.865625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2218ff3-efd2-4368-a17e-7b200dd3440f None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:46.903733 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e89d0-678c-459f-a0de-109009356447 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:46.904023 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e89d0-678c-459f-a0de-109009356447 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:46.904445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e89d0-678c-459f-a0de-109009356447 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:46.906235 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 371/747] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:46.911965 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4ac9-470d-4e40-b4f3-2e72ed07029c None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:46.912300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4ac9-470d-4e40-b4f3-2e72ed07029c None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:46.912509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4ac9-470d-4e40-b4f3-2e72ed07029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:46.933817 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-2fdb4ac9-470d-4e40-b4f3-2e72ed07029c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:46.935104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-2fdb4ac9-470d-4e40-b4f3-2e72ed07029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:47.017780 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 372/748] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:46 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:47.075174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c68c2-d1a5-4890-bdf5-8dede0caa5e7 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.075801 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c68c2-d1a5-4890-bdf5-8dede0caa5e7 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.075801 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c68c2-d1a5-4890-bdf5-8dede0caa5e7 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.077432 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 373/749] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:47.082540 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c36f50-c272-4ee5-9cd3-cfaae5417ab0 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.082826 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c36f50-c272-4ee5-9cd3-cfaae5417ab0 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.083133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c36f50-c272-4ee5-9cd3-cfaae5417ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.101349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-40c36f50-c272-4ee5-9cd3-cfaae5417ab0 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:47.102549 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-40c36f50-c272-4ee5-9cd3-cfaae5417ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:47.105799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2218ff3-efd2-4368-a17e-7b200dd3440f None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:47.132741 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:47.133862 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:47.142523 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:47.143193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.143471 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.143738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.154171 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:47.155757 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:27:47.170197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:47.171304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:27:47.172688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:27:47.172688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:27:47.172688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:27:47.172688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 377/750] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:47.177205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:47.180728 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 374/751] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:47.279519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69b51f-561d-4813-bf8e-7411fd4d24af None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:47.314462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:47.315475 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.316010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.316491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.317328 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:47.317826 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:47.319452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:47.336848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 378/752] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:47.338772 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c36f50-c272-4ee5-9cd3-cfaae5417ab0 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:47.450495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c36f50-c272-4ee5-9cd3-cfaae5417ab0 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:47.488983 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:47.489616 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.489859 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.490149 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.490756 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:47.492186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:47.501857 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:47.502958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:47.504231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:47.507452 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 375/753] 10.222.0.69 () {56 vars in 1132 bytes} [Fri Aug 19 02:27:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:47.509021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:47.520021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:47.554583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:47.560916 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:47.629641 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84e4af-7bb7-4ad9-8115-33d8fef7bfeb None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:47.638613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc53c2-8121-4a4a-9080-54e16e5258e6 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:47.667894 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:47.668501 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.668774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.669042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.669656 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:47.669951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:47.671390 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:47.676322 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 379/754] 10.222.0.69 () {56 vars in 1126 bytes} [Fri Aug 19 02:27:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:47.680241 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:47.680880 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.681220 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.681497 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.682077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:47.682167 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:47.683486 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:47.692183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:47.693263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:47.694093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 376/755] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:47.699260 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:47.783912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7120e-0310-4023-8c22-6c5ebf0cb619 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:47.785625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:47.797474 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:47.803800 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97496569-1e6b-482f-9165-3503d84c7601 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:47.820439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:47.820986 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.821259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.821526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.822146 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:47.822446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:47.823857 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:47.828333 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 380/756] 10.222.0.69 () {56 vars in 1126 bytes} [Fri Aug 19 02:27:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:47.838305 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14aadf-2fc5-417b-b125-91b549df4ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:47.838938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14aadf-2fc5-417b-b125-91b549df4ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:47.839269 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14aadf-2fc5-417b-b125-91b549df4ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:47.839654 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14aadf-2fc5-417b-b125-91b549df4ad3 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:47.840313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14aadf-2fc5-417b-b125-91b549df4ad3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:47.840621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14aadf-2fc5-417b-b125-91b549df4ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:47.842039 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14aadf-2fc5-417b-b125-91b549df4ad3 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:47.847838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 377/757] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:47.853940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:47.962588 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30169263-6864-4d7b-bfea-c8b0c67a2609 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:48.001488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb58c-d6ce-47ba-84db-82206bd074e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:48.002073 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb58c-d6ce-47ba-84db-82206bd074e0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:48.002344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb58c-d6ce-47ba-84db-82206bd074e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:48.002606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb58c-d6ce-47ba-84db-82206bd074e0 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:48.003280 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb58c-d6ce-47ba-84db-82206bd074e0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:48.003575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb58c-d6ce-47ba-84db-82206bd074e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:48.004953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb58c-d6ce-47ba-84db-82206bd074e0 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:48.009781 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 381/758] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:49.999440 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9aec-a20d-4f06-8be5-01c857421b22 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:50.000005 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9aec-a20d-4f06-8be5-01c857421b22 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:50.000005 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9aec-a20d-4f06-8be5-01c857421b22 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:50.001358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 378/759] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:50.007048 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d6215-3406-4f2a-b960-feedbb698b0f None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:50.007551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d6215-3406-4f2a-b960-feedbb698b0f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:50.007645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d6215-3406-4f2a-b960-feedbb698b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:50.027109 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-660d6215-3406-4f2a-b960-feedbb698b0f None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:50.028193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-660d6215-3406-4f2a-b960-feedbb698b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:50.054605 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:50.103915 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 382/760] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:50 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:50.226271 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8027-fb2e-46ca-b0e3-8101c29eeca3 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:50.226551 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8027-fb2e-46ca-b0e3-8101c29eeca3 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:50.226819 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8027-fb2e-46ca-b0e3-8101c29eeca3 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:50.228211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 379/761] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:50.233732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9c41-ac81-4ea1-bd7a-543ca3eae277 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:50.234012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9c41-ac81-4ea1-bd7a-543ca3eae277 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:50.234287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9c41-ac81-4ea1-bd7a-543ca3eae277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:50.253337 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-b8dd9c41-ac81-4ea1-bd7a-543ca3eae277 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:50.254663 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-b8dd9c41-ac81-4ea1-bd7a-543ca3eae277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:50.326271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 383/762] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:50 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:50.425655 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e8027-fb2e-46ca-b0e3-8101c29eeca3 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:50.533921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e8027-fb2e-46ca-b0e3-8101c29eeca3 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:50.568343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e88c68-00bb-4007-be36-5b5aab0d1555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:50.568943 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88c68-00bb-4007-be36-5b5aab0d1555 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:50.569215 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88c68-00bb-4007-be36-5b5aab0d1555 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:50.569479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88c68-00bb-4007-be36-5b5aab0d1555 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:50.570122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e88c68-00bb-4007-be36-5b5aab0d1555 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:50.571532 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e88c68-00bb-4007-be36-5b5aab0d1555 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:50.587283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 380/763] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:27:50 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:50.652577 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd9c41-ac81-4ea1-bd7a-543ca3eae277 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:50.754744 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:50.767653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd9c41-ac81-4ea1-bd7a-543ca3eae277 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:50.807566 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90354816-f018-4c9a-a7b5-88c5d532783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:50.808172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354816-f018-4c9a-a7b5-88c5d532783a None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:50.808444 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354816-f018-4c9a-a7b5-88c5d532783a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:50.808702 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354816-f018-4c9a-a7b5-88c5d532783a None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:50.809329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90354816-f018-4c9a-a7b5-88c5d532783a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:50.810676 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90354816-f018-4c9a-a7b5-88c5d532783a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:50.827039 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 384/764] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:27:50 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:52.754124 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728046a2-6c91-4979-bb09-6115f57196e7 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:52.754683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728046a2-6c91-4979-bb09-6115f57196e7 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:52.754683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728046a2-6c91-4979-bb09-6115f57196e7 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:52.756003 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 381/765] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:52.761724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1bf5-f79f-4296-810b-bc111588cce4 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:52.762209 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1bf5-f79f-4296-810b-bc111588cce4 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:52.762287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1bf5-f79f-4296-810b-bc111588cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:52.781333 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-205c1bf5-f79f-4296-810b-bc111588cce4 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:52.782536 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-205c1bf5-f79f-4296-810b-bc111588cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:52.861352 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 385/766] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:52 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:52.998959 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94779-11ad-4071-aebd-29549186bad0 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:52.999245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94779-11ad-4071-aebd-29549186bad0 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:52.999546 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94779-11ad-4071-aebd-29549186bad0 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.000868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 382/767] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:53.006235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335bf47-9429-4ab7-8ea7-e94b9c5ae89f None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.006402 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335bf47-9429-4ab7-8ea7-e94b9c5ae89f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.006701 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335bf47-9429-4ab7-8ea7-e94b9c5ae89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.025430 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-6335bf47-9429-4ab7-8ea7-e94b9c5ae89f None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:53.026600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-6335bf47-9429-4ab7-8ea7-e94b9c5ae89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:53.096448 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 386/768] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:53 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:53.179448 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94779-11ad-4071-aebd-29549186bad0 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.203428 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:53.293871 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94779-11ad-4071-aebd-29549186bad0 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:53.330978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:53.331893 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.332178 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.332444 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.333029 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:53.334384 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:53.343957 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:53.345678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:53.347891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 383/769] 10.222.0.69 () {56 vars in 1132 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:53.353031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335bf47-9429-4ab7-8ea7-e94b9c5ae89f None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.355738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:53.417777 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.459402 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335bf47-9429-4ab7-8ea7-e94b9c5ae89f None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:53.494953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:53.495582 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.495848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.496107 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.496896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:53.497106 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:53.498532 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:53.503832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 387/770] 10.222.0.69 () {56 vars in 1126 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:53.509526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.517930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:53.533555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84a876-2981-4211-9703-00ebee5fd909 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:53.567587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:53.568140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.568410 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.568674 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.569247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:53.570695 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:53.573579 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:53.579146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:53.583238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:53.584231 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 384/771] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:27:53.586079 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.615035 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d399-c518-44f8-a2e5-609b50701850 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:53.648968 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:53.649562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.649830 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.650092 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.650711 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:53.651031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:53.652439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:53.657126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 388/772] 10.222.0.69 () {56 vars in 1126 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:53.663154 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.685712 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3650c-ca68-4557-a3b9-61d44cced24c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:53.719975 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:53.720572 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.720848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.721123 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.721752 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:53.722049 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:53.723456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:53.727976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 385/773] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:53.733806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.748798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:53.770417 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41dbf-3a33-46ae-868d-40a762828e20 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:53.813514 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:53.820875 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:53.821608 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.821885 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.822156 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.822863 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] RBAC: Adding query filter params (interface=public, service_id=b5c1408a7d4b49628711d11a1e1efed2, region_id=RegionOne) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:53.823219 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:53.824604 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:53.831285 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 389/774] 10.222.0.69 () {56 vars in 1251 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/endpoints?service_id=b5c1408a7d4b49628711d11a1e1efed2&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:53.837011 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.843485 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55e5cf-a1cf-49cb-bd51-e547dde1f90e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:53.891404 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:53.892010 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.892311 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.892591 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.893211 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:53.893529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:53.894912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:53.900599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 386/775] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:53.906730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:53.938674 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f129a44-c88b-4b32-bdef-590fe9a2af7d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:53.972359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b327bdc-23b0-4726-8a0f-795c6ccfd44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:53.972968 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b327bdc-23b0-4726-8a0f-795c6ccfd44f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:53.973239 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b327bdc-23b0-4726-8a0f-795c6ccfd44f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:53.973507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b327bdc-23b0-4726-8a0f-795c6ccfd44f None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:53.974105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b327bdc-23b0-4726-8a0f-795c6ccfd44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:53.975513 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b327bdc-23b0-4726-8a0f-795c6ccfd44f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:53.981274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 390/776] 10.222.0.69 () {56 vars in 1087 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:27:53.983129 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:54.009683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170372-14a5-4a56-875c-d39ed9812565 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:54.049625 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c424bd-dab1-4053-9b22-90476b3814c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:54.050258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c424bd-dab1-4053-9b22-90476b3814c5 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:54.050527 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c424bd-dab1-4053-9b22-90476b3814c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:54.050839 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c424bd-dab1-4053-9b22-90476b3814c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:54.051588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c424bd-dab1-4053-9b22-90476b3814c5 None admin] RBAC: Adding query filter params (interface=public, service_id=ba59f32ff0f24b1e91fdcc82789d364a, region_id=RegionOne) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:54.051893 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c424bd-dab1-4053-9b22-90476b3814c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:54.053291 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c424bd-dab1-4053-9b22-90476b3814c5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:54.059573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 387/777] 10.222.0.69 () {56 vars in 1251 bytes} [Fri Aug 19 02:27:53 2022] GET /identity/v3/endpoints?service_id=ba59f32ff0f24b1e91fdcc82789d364a&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:54.065487 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b327bdc-23b0-4726-8a0f-795c6ccfd44f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:54.129949 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:54.174348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b327bdc-23b0-4726-8a0f-795c6ccfd44f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:54.212023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457d56-42f5-4727-a624-b67a9499ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:54.212705 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457d56-42f5-4727-a624-b67a9499ec7b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:54.212978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457d56-42f5-4727-a624-b67a9499ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:54.213245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457d56-42f5-4727-a624-b67a9499ec7b None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:54.213851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c457d56-42f5-4727-a624-b67a9499ec7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:54.215271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c457d56-42f5-4727-a624-b67a9499ec7b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:54.222420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 391/778] 10.222.0.69 () {56 vars in 1087 bytes} [Fri Aug 19 02:27:54 2022] GET /identity/v3/services => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:27:56.169601 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32e94-25d5-4ff8-9d27-0adc9e753daa None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:56.170256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32e94-25d5-4ff8-9d27-0adc9e753daa None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:56.170256 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32e94-25d5-4ff8-9d27-0adc9e753daa None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:56.171551 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 388/779] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:56.177056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e220b-f67e-4fd5-84e0-54263f12b564 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:56.177494 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e220b-f67e-4fd5-84e0-54263f12b564 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:56.177591 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e220b-f67e-4fd5-84e0-54263f12b564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:56.196703 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-f03e220b-f67e-4fd5-84e0-54263f12b564 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:56.197875 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-f03e220b-f67e-4fd5-84e0-54263f12b564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:56.275552 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 392/780] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:56.391352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d41acf-3898-4d03-a4db-932027d8280b None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:56.391614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d41acf-3898-4d03-a4db-932027d8280b None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:56.391909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d41acf-3898-4d03-a4db-932027d8280b None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:56.393236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 389/781] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:56.398729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932245c0-e9b5-4d0d-b1ad-aa5478724056 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:56.399021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932245c0-e9b5-4d0d-b1ad-aa5478724056 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:56.399384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932245c0-e9b5-4d0d-b1ad-aa5478724056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:56.418338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-932245c0-e9b5-4d0d-b1ad-aa5478724056 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:56.419532 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-932245c0-e9b5-4d0d-b1ad-aa5478724056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:56.468632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:56.489681 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 393/782] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:56.594865 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d41acf-3898-4d03-a4db-932027d8280b None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:56.702883 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d41acf-3898-4d03-a4db-932027d8280b None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:56.737915 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:56.738489 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:56.738776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:56.739029 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:56.739640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:56.741006 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:56.749848 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:56.751127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:56.752358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 390/783] 10.222.0.69 () {56 vars in 1132 bytes} [Fri Aug 19 02:27:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:56.757005 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932245c0-e9b5-4d0d-b1ad-aa5478724056 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:56.812555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:56.817084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:56.858562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932245c0-e9b5-4d0d-b1ad-aa5478724056 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:56.892320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:56.892927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:56.893197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:56.893462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:56.894083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:56.894383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:56.895783 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:56.900733 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 394/784] 10.222.0.69 () {56 vars in 1126 bytes} [Fri Aug 19 02:27:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:27:56.906567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:56.914875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed81af-84e9-4409-9ec3-e616cc0202ae None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:56.948096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:56.948784 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:56.949053 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:56.949316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:56.949892 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:56.950622 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:56.951407 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:56.960290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:56.961382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:56.962240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 391/785] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:56.967316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:57.005729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0d369-4cd6-4e4c-9790-1abec7b33924 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:57.032438 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:57.039575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:57.040175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:57.040446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:57.040710 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:57.041337 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:57.041632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:57.043012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:57.048066 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 395/786] 10.222.0.69 () {56 vars in 1126 bytes} [Fri Aug 19 02:27:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:57.054133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:57.066606 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19172e5-9dcb-42ca-892b-2e0d01db4338 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:57.102368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:57.102988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:57.103346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:57.103613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:57.104240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:57.104538 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:57.105902 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:57.110698 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 392/787] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:57.116372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:57.153386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a350-4881-493a-8f32-6047f196d0b8 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:57.164147 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:57.186886 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf37b75-af52-41da-a38b-d47dfd685e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:57.187588 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37b75-af52-41da-a38b-d47dfd685e0b None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:57.187784 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37b75-af52-41da-a38b-d47dfd685e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:57.188050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37b75-af52-41da-a38b-d47dfd685e0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:57.188708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf37b75-af52-41da-a38b-d47dfd685e0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:57.190106 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf37b75-af52-41da-a38b-d47dfd685e0b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:57.209794 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 396/788] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:27:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:27:57.218523 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620bb2-7cf4-4297-a2f0-e7b01a80d471 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:57.251573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:57.263804 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262b43c-401a-440a-9aaf-28244eb5c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:57.264363 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262b43c-401a-440a-9aaf-28244eb5c50c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:57.264638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262b43c-401a-440a-9aaf-28244eb5c50c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:57.264906 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262b43c-401a-440a-9aaf-28244eb5c50c None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:57.265547 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262b43c-401a-440a-9aaf-28244eb5c50c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:27:57.265847 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262b43c-401a-440a-9aaf-28244eb5c50c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:57.267278 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262b43c-401a-440a-9aaf-28244eb5c50c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:57.272862 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 393/789] 10.222.0.69 () {56 vars in 1114 bytes} [Fri Aug 19 02:27:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:27:57.279270 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf37b75-af52-41da-a38b-d47dfd685e0b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:57.387766 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf37b75-af52-41da-a38b-d47dfd685e0b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:57.422044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f109f-7d94-445a-8875-229118ed6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:57.422655 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f109f-7d94-445a-8875-229118ed6882 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:57.422929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f109f-7d94-445a-8875-229118ed6882 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:57.423225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f109f-7d94-445a-8875-229118ed6882 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:57.423905 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f109f-7d94-445a-8875-229118ed6882 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:57.425277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f109f-7d94-445a-8875-229118ed6882 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:57.445556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 397/790] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:27:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:27:59.395166 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf987-368a-4f07-b675-cff7cd172d1e None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:59.395724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf987-368a-4f07-b675-cff7cd172d1e None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:59.395724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf987-368a-4f07-b675-cff7cd172d1e None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:59.397044 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 394/791] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:59.402423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ce7cc-5164-42a1-b344-9b691bcd205b None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:59.402824 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ce7cc-5164-42a1-b344-9b691bcd205b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:59.403023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ce7cc-5164-42a1-b344-9b691bcd205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:59.422358 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-5b4ce7cc-5164-42a1-b344-9b691bcd205b None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:59.423598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-5b4ce7cc-5164-42a1-b344-9b691bcd205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:59.445377 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:59.511113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 398/792] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:59.596900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1565255-1b06-4061-acb9-9170ccba47d3 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:59.597179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1565255-1b06-4061-acb9-9170ccba47d3 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:59.597452 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1565255-1b06-4061-acb9-9170ccba47d3 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:59.598821 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 395/793] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:59.604835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbebc2-a49f-467f-aef1-65ad4b470806 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:59.605223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbebc2-a49f-467f-aef1-65ad4b470806 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:59.605574 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbebc2-a49f-467f-aef1-65ad4b470806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:59.629280 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-3bcbebc2-a49f-467f-aef1-65ad4b470806 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:59.630807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-3bcbebc2-a49f-467f-aef1-65ad4b470806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:59.703536 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 399/794] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:27:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:27:59.828636 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1565255-1b06-4061-acb9-9170ccba47d3 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:59.934617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1565255-1b06-4061-acb9-9170ccba47d3 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:59.969846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:59.970397 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:59.970668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:59.970939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:59.971536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:59.972895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:27:59.981562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:27:59.982858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:27:59.983976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:27:59.987356 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 396/795] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:27:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:27:59.988711 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbebc2-a49f-467f-aef1-65ad4b470806 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:00.059148 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:00.069116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:00.096050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbebc2-a49f-467f-aef1-65ad4b470806 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:00.121142 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:00.132084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:00.132694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:00.132965 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:00.133226 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:00.133852 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] RBAC: Adding query filter params (name=compute) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:00.134145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:00.135559 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:00.140293 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 400/796] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:27:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:00.146096 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:00.166291 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905e505-ff14-4915-9f42-d611fa33284e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:00.203888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:00.204495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:00.204757 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:00.205044 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:00.205665 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:00.207285 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:00.209940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING keystone.server.flask.common [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 02:28:00.228310 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.sql.core [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 02:28:00.228310 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 02:28:00.228310 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [parameters: {'id': 'a1096b1a3b9e47d3ac36cf1059016358', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 02:28:00.228310 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88489) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1096b1a3b9e47d3ac36cf1059016358.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1096b1a3b9e47d3ac36cf1059016358. Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:28:00.245980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application result.read() Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 02:28:00.247104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application yield resource Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise self.value Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application session.commit() Aug 19 02:28:00.248207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self.session.flush() Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application compat.raise_( Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 02:28:00.249162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 02:28:00.250162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application result.read() Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:28:00.251141 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [parameters: {'id': 'a1096b1a3b9e47d3ac36cf1059016358', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:00.252063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:28:00.252889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1096b1a3b9e47d3ac36cf1059016358. Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:00.253834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 397/797] 10.222.0.69 () {60 vars in 1140 bytes} [Fri Aug 19 02:28:00 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:28:00.254669 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:00.256094 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6e4c-a15e-4921-a1b4-0a950a88fccf None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:00.292361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:00.293035 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:00.293304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:00.293569 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:00.294226 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:00.294522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:00.296008 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:00.312485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 401/798] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:28:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:00.365414 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4cd2a-63c7-43d2-aa59-ca74561e4894 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:00.383613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:00.409328 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afceb5-6321-4d6a-bd2a-dfad0523eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:00.410043 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afceb5-6321-4d6a-bd2a-dfad0523eab8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:00.410259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afceb5-6321-4d6a-bd2a-dfad0523eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:00.410516 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afceb5-6321-4d6a-bd2a-dfad0523eab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:00.418662 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afceb5-6321-4d6a-bd2a-dfad0523eab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:00.420376 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afceb5-6321-4d6a-bd2a-dfad0523eab8 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-74afceb5-6321-4d6a-bd2a-dfad0523eab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:28:00.432445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:28:00.433610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:28:00.434775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:28:00.434775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:28:00.434775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:28:00.434775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:28:00.434775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:28:00.434775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:28:00.434775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:28:00.434775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:00.435635 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 398/799] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:28:00.440049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:00.450255 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:00.547680 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3d97-8c48-4dbb-b886-f5e6d4d394e8 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:00.582951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a2ee6-a7d7-4fb1-aa0e-ef7fc70bdba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:00.583642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2ee6-a7d7-4fb1-aa0e-ef7fc70bdba0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:00.583909 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2ee6-a7d7-4fb1-aa0e-ef7fc70bdba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:00.584173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2ee6-a7d7-4fb1-aa0e-ef7fc70bdba0 None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:00.584839 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a2ee6-a7d7-4fb1-aa0e-ef7fc70bdba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:00.585133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a2ee6-a7d7-4fb1-aa0e-ef7fc70bdba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:00.586586 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a2ee6-a7d7-4fb1-aa0e-ef7fc70bdba0 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:00.607054 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 402/800] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:28:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:02.467767 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c870da6-a858-4599-972d-56e38a1ecf85 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:02.468340 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c870da6-a858-4599-972d-56e38a1ecf85 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:02.468340 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c870da6-a858-4599-972d-56e38a1ecf85 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:02.473090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 399/801] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:28:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:28:02.480115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ffd6-6605-48f6-96cf-12c162f47344 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:02.480115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ffd6-6605-48f6-96cf-12c162f47344 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:02.480115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0ffd6-6605-48f6-96cf-12c162f47344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:02.501694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-29e0ffd6-6605-48f6-96cf-12c162f47344 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:28:02.502898 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-29e0ffd6-6605-48f6-96cf-12c162f47344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:28:02.577953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:02.587924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 403/802] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:28:02 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:28:02.830361 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ec48-7eef-45c4-b280-a5a4c005fd09 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:02.830826 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ec48-7eef-45c4-b280-a5a4c005fd09 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:02.831327 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ec48-7eef-45c4-b280-a5a4c005fd09 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:02.833093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 400/803] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:28:02.840592 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86036c0-8633-4c23-a5a3-02de4a0fd6c9 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:02.841068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86036c0-8633-4c23-a5a3-02de4a0fd6c9 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:02.841371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86036c0-8633-4c23-a5a3-02de4a0fd6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:02.862732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-b86036c0-8633-4c23-a5a3-02de4a0fd6c9 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:28:02.863972 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-b86036c0-8633-4c23-a5a3-02de4a0fd6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:28:02.910451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72ec48-7eef-45c4-b280-a5a4c005fd09 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:02.939058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 404/804] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:28:02 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:28:03.021740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72ec48-7eef-45c4-b280-a5a4c005fd09 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:03.058390 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7351c-e484-4ee5-8a9f-dd122dcec9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:03.059016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7351c-e484-4ee5-8a9f-dd122dcec9e5 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:03.059296 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7351c-e484-4ee5-8a9f-dd122dcec9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:03.059564 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7351c-e484-4ee5-8a9f-dd122dcec9e5 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:03.060215 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7351c-e484-4ee5-8a9f-dd122dcec9e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:03.061632 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7351c-e484-4ee5-8a9f-dd122dcec9e5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:03.077007 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 401/805] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:28:02 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:28:03.309986 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86036c0-8633-4c23-a5a3-02de4a0fd6c9 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:03.416507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86036c0-8633-4c23-a5a3-02de4a0fd6c9 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:03.443193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:03.458687 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:03.459331 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:03.459608 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:03.459879 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:03.460503 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:03.461942 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:03.464518 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING keystone.server.flask.common [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 02:28:03.477617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.sql.core [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 02:28:03.477617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 02:28:03.477617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [parameters: {'user_id': '9a6527389277412886be4dfde473e1ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 02:28:03.477617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88490) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application result.read() Aug 19 02:28:03.493735 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:28:03.495342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application yield resource Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise self.value Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application session.commit() Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 02:28:03.496573 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self.session.flush() Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application compat.raise_( Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 02:28:03.497665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:28:03.498893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application result.read() Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:28:03.500083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [parameters: {'user_id': '9a6527389277412886be4dfde473e1ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:28:03.501126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 02:28:03.502291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 02:28:03.503585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 02:28:03.503585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 02:28:03.503585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 02:28:03.503585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 02:28:03.503585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 02:28:03.503585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:28:03.503585 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 405/806] 10.222.0.69 () {60 vars in 1131 bytes} [Fri Aug 19 02:28:03 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:28:03.504054 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7351c-e484-4ee5-8a9f-dd122dcec9e5 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:03.534564 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:03.607127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7351c-e484-4ee5-8a9f-dd122dcec9e5 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:03.641013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddca850-4713-4c7e-b7a8-146bcdfa1062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:03.641637 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca850-4713-4c7e-b7a8-146bcdfa1062 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:03.641911 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca850-4713-4c7e-b7a8-146bcdfa1062 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:03.642158 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca850-4713-4c7e-b7a8-146bcdfa1062 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:03.649493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddca850-4713-4c7e-b7a8-146bcdfa1062 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:03.650932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddca850-4713-4c7e-b7a8-146bcdfa1062 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-8ddca850-4713-4c7e-b7a8-146bcdfa1062 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:28:03.661495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:28:03.663368 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:03.664648 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 402/807] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:28:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:28:03.668848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:03.799401 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457edfa-ef39-482d-90a9-71258e226191 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:03.835107 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69aeca-6e35-4fc1-b8d3-2f74defa37bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:03.835717 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69aeca-6e35-4fc1-b8d3-2f74defa37bf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:03.835992 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69aeca-6e35-4fc1-b8d3-2f74defa37bf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:03.836271 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69aeca-6e35-4fc1-b8d3-2f74defa37bf None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:03.836956 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69aeca-6e35-4fc1-b8d3-2f74defa37bf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:03.837258 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69aeca-6e35-4fc1-b8d3-2f74defa37bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:03.838943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69aeca-6e35-4fc1-b8d3-2f74defa37bf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:03.876415 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 406/808] 10.222.0.69 () {56 vars in 1101 bytes} [Fri Aug 19 02:28:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:05.281129 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93beeb-66fc-4e2f-827a-c2763f96e057 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:05.281675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93beeb-66fc-4e2f-827a-c2763f96e057 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:05.281675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93beeb-66fc-4e2f-827a-c2763f96e057 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:05.282985 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 403/809] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:28:05.288616 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9f5e-9b73-4c61-8510-a9878abbcc43 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:05.289066 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9f5e-9b73-4c61-8510-a9878abbcc43 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:05.289155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9f5e-9b73-4c61-8510-a9878abbcc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:05.308140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-85ef9f5e-9b73-4c61-8510-a9878abbcc43 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:28:05.309631 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-85ef9f5e-9b73-4c61-8510-a9878abbcc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:28:05.346142 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:05.377535 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 407/810] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:28:05 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:28:05.698702 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93beeb-66fc-4e2f-827a-c2763f96e057 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:05.805393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:05.816394 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93beeb-66fc-4e2f-827a-c2763f96e057 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:05.852417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:05.853054 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:05.853328 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:05.853592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:05.854175 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:05.855596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:28:05.864874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:28:05.866928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:28:05.867905 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 404/811] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:28:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:28:05.872304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9f5e-9b73-4c61-8510-a9878abbcc43 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:05.982268 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9f5e-9b73-4c61-8510-a9878abbcc43 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:06.021144 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:06.021738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:06.022008 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:06.022265 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:06.022881 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:06.023205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:06.024572 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:06.029324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 408/812] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:28:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:06.035607 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:06.166283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4d22-3d65-49f8-9685-f6a2faf5f959 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:06.206487 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:06.207116 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:06.207388 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:06.207657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:06.208293 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:06.208588 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:06.209959 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:06.215615 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 405/813] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:28:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:06.222627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:06.260320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:06.330577 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffbb3d-6979-4713-8ca2-4071efa5a138 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:06.365667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e714f-8c1b-48eb-925d-dbf58416eb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:06.366290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e714f-8c1b-48eb-925d-dbf58416eb52 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:06.366570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e714f-8c1b-48eb-925d-dbf58416eb52 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:06.366851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e714f-8c1b-48eb-925d-dbf58416eb52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:06.367561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e714f-8c1b-48eb-925d-dbf58416eb52 None admin] RBAC: Adding query filter params (interface=public, service_id=6b5981055b344ee898e6feae50b50326, region_id=RegionOne) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:06.367866 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e714f-8c1b-48eb-925d-dbf58416eb52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:06.369257 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e714f-8c1b-48eb-925d-dbf58416eb52 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:06.374430 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 409/814] 10.222.0.69 () {56 vars in 1251 bytes} [Fri Aug 19 02:28:06 2022] GET /identity/v3/endpoints?service_id=6b5981055b344ee898e6feae50b50326&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:06.380704 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:06.417667 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:06.509277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e130e-cf3f-4ce3-b9c7-ba4cdccee5e1 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:06.543057 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dda764-cc8e-4ef1-b05c-f70a9d687cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:06.543645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dda764-cc8e-4ef1-b05c-f70a9d687cce None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:06.543920 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dda764-cc8e-4ef1-b05c-f70a9d687cce None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:06.544159 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dda764-cc8e-4ef1-b05c-f70a9d687cce None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:06.544882 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dda764-cc8e-4ef1-b05c-f70a9d687cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:06.546251 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dda764-cc8e-4ef1-b05c-f70a9d687cce None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:06.552856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 406/815] 10.222.0.69 () {56 vars in 1087 bytes} [Fri Aug 19 02:28:06 2022] GET /identity/v3/services => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:28:08.782083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff4341-4a0e-4023-a437-7f89168ebc7d None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:08.782615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff4341-4a0e-4023-a437-7f89168ebc7d None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:08.782615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff4341-4a0e-4023-a437-7f89168ebc7d None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:08.784015 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 410/816] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:28:08.793466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834de37-bb17-46aa-bffd-3f208a7208cb None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:08.793904 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834de37-bb17-46aa-bffd-3f208a7208cb None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:08.793992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834de37-bb17-46aa-bffd-3f208a7208cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:08.813056 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b834de37-bb17-46aa-bffd-3f208a7208cb None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:28:08.814591 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b834de37-bb17-46aa-bffd-3f208a7208cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:28:08.889714 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 407/817] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:28:08 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:28:09.210913 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff4341-4a0e-4023-a437-7f89168ebc7d None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:09.315029 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:09.319901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff4341-4a0e-4023-a437-7f89168ebc7d None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:09.356967 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:09.357595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:09.357866 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:09.358127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:09.358971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:09.360105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:28:09.368763 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:28:09.369848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:28:09.370858 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 411/818] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:28:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:28:09.377601 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834de37-bb17-46aa-bffd-3f208a7208cb None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:09.399215 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:09.491513 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834de37-bb17-46aa-bffd-3f208a7208cb None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:09.527621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:09.528228 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:09.528504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:09.528796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:09.529430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] RBAC: Adding query filter params (name=compute) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:09.529734 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:09.531156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:09.535936 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 408/819] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:28:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:09.544377 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:09.656490 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc478e-ab9c-40f3-8a3c-4a2208ca8b89 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:09.693155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6959ee-40d9-4b83-af55-7d0210558671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:09.693953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6959ee-40d9-4b83-af55-7d0210558671 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:09.694325 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6959ee-40d9-4b83-af55-7d0210558671 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:09.694665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6959ee-40d9-4b83-af55-7d0210558671 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:09.695578 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6959ee-40d9-4b83-af55-7d0210558671 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:28:09.695986 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6959ee-40d9-4b83-af55-7d0210558671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:09.697880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6959ee-40d9-4b83-af55-7d0210558671 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:09.705752 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 412/820] 10.222.0.69 () {56 vars in 1112 bytes} [Fri Aug 19 02:28:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:28:09.711943 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:09.793041 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:09.815522 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68678c66-7ba2-4d6f-b16f-5c309fd9ae7e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:09.851628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298855b-9ce0-4896-8d3c-eab409c18217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:09.852261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298855b-9ce0-4896-8d3c-eab409c18217 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:09.852540 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298855b-9ce0-4896-8d3c-eab409c18217 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:09.852804 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298855b-9ce0-4896-8d3c-eab409c18217 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:09.853471 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298855b-9ce0-4896-8d3c-eab409c18217 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:09.854838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298855b-9ce0-4896-8d3c-eab409c18217 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:09.879567 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 409/821] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:28:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:28:19.701044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=86 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:19.874673 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:12.990348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc7ef2-12bb-4a4d-b1dd-ccf946c4afc9 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:12.990947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc7ef2-12bb-4a4d-b1dd-ccf946c4afc9 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:12.990947 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc7ef2-12bb-4a4d-b1dd-ccf946c4afc9 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:12.992486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 413/822] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:12.998277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d116e-f85a-4f57-8dfb-d76ca9e9500a None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:12.998927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d116e-f85a-4f57-8dfb-d76ca9e9500a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:12.998927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d116e-f85a-4f57-8dfb-d76ca9e9500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:13.019732 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-976d116e-f85a-4f57-8dfb-d76ca9e9500a None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:13.021001 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-976d116e-f85a-4f57-8dfb-d76ca9e9500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:13.120881 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 410/823] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:12 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:13.452288 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc7ef2-12bb-4a4d-b1dd-ccf946c4afc9 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:13.571225 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc7ef2-12bb-4a4d-b1dd-ccf946c4afc9 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:13.616829 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:13.617604 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:13.617854 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:13.618131 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:13.633100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:13.635042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:13.656694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:13.658267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:13.659596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:13.659596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:13.659596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:13.659596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 414/824] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:13.663715 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d116e-f85a-4f57-8dfb-d76ca9e9500a None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:13.795425 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d116e-f85a-4f57-8dfb-d76ca9e9500a None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:13.829004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:13.845938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91874128-8d5f-45cc-99b2-c86fdbf8ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:13.845938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874128-8d5f-45cc-99b2-c86fdbf8ae20 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:13.845938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874128-8d5f-45cc-99b2-c86fdbf8ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:13.845938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874128-8d5f-45cc-99b2-c86fdbf8ae20 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:13.846372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91874128-8d5f-45cc-99b2-c86fdbf8ae20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:13.846372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91874128-8d5f-45cc-99b2-c86fdbf8ae20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:13.846372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91874128-8d5f-45cc-99b2-c86fdbf8ae20 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:13.858115 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 411/825] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:13.864380 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:13.927334 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:13.987129 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967a013-854d-46b6-9bdc-208df66d666b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:14.027304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9987815-5a66-4827-826b-5ce40653195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:14.028081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987815-5a66-4827-826b-5ce40653195a None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:14.028171 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987815-5a66-4827-826b-5ce40653195a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:14.028389 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987815-5a66-4827-826b-5ce40653195a None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:14.029039 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9987815-5a66-4827-826b-5ce40653195a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:14.030452 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9987815-5a66-4827-826b-5ce40653195a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:14.064294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 415/826] 10.222.0.69 () {60 vars in 1132 bytes} [Fri Aug 19 02:29:13 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:29:16.469305 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621968b9-061a-49ae-9bf6-4a863895799a None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:16.469868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621968b9-061a-49ae-9bf6-4a863895799a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:16.470013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621968b9-061a-49ae-9bf6-4a863895799a None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:16.471385 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 412/827] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:16.477423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2dfb9-f7b7-4168-ad41-9d15d665d20c None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:16.477894 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2dfb9-f7b7-4168-ad41-9d15d665d20c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:16.478016 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2dfb9-f7b7-4168-ad41-9d15d665d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:16.498033 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-0bb2dfb9-f7b7-4168-ad41-9d15d665d20c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:16.499295 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-0bb2dfb9-f7b7-4168-ad41-9d15d665d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:16.574223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 416/828] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:16.900005 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621968b9-061a-49ae-9bf6-4a863895799a None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:17.020927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621968b9-061a-49ae-9bf6-4a863895799a None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:17.059156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda53c-d5df-44ed-b6f0-7ac0220ab182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:17.059794 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda53c-d5df-44ed-b6f0-7ac0220ab182 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:17.060126 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda53c-d5df-44ed-b6f0-7ac0220ab182 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:17.060419 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda53c-d5df-44ed-b6f0-7ac0220ab182 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:17.071740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda53c-d5df-44ed-b6f0-7ac0220ab182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-e6eda53c-d5df-44ed-b6f0-7ac0220ab182 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:29:17.076405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:17.078016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:17.079064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 413/829] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:17.083980 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2dfb9-f7b7-4168-ad41-9d15d665d20c None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:17.128057 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:17.201010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2dfb9-f7b7-4168-ad41-9d15d665d20c None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:17.242713 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:17.243394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:17.243685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:17.243970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:17.244690 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:17.245012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:17.246572 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:17.255549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 417/830] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:17.261806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda53c-d5df-44ed-b6f0-7ac0220ab182 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:17.316020 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:17.378660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda53c-d5df-44ed-b6f0-7ac0220ab182 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:17.415404 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:17.416250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:17.416633 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:17.416908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:17.429122 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:17.431014 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:17.447437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:17.448671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:17.449641 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:17.449641 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:17.449641 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:17.449641 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 414/831] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:17.455382 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:17.570424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:17.573437 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d433447-3297-4cac-91a5-766ff2befcbb None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:17.613099 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:17.613957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:17.614237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:17.614694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:17.615614 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:17.616119 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:17.618080 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:17.633453 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 418/832] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:29:17.641171 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:17.752402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:17.757021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921cdd-29d3-4793-80ea-7b84c53327c5 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:17.794940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:17.795605 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:17.795879 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:17.796151 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:17.803693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:17.805131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:29:17.816678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:17.817978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:17.819140 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 415/833] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:17.824042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:17.932497 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef26bb-ef22-4508-b8a9-560f82c8479c None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:17.968132 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978509-e286-4f69-aace-0ef11267552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:17.969769 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978509-e286-4f69-aace-0ef11267552f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:17.969769 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978509-e286-4f69-aace-0ef11267552f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:17.969769 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978509-e286-4f69-aace-0ef11267552f None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:17.970350 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978509-e286-4f69-aace-0ef11267552f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:17.970810 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978509-e286-4f69-aace-0ef11267552f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:17.972748 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978509-e286-4f69-aace-0ef11267552f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:17.992741 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 419/834] 10.222.0.69 () {56 vars in 1143 bytes} [Fri Aug 19 02:29:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:29:17.999193 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:18.110569 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef772dd2-f458-47ae-a0fc-2c2afdb99338 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:18.149943 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56045b7f-4a9a-42ed-bb3e-bc2787032e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:18.150666 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045b7f-4a9a-42ed-bb3e-bc2787032e25 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:18.150975 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045b7f-4a9a-42ed-bb3e-bc2787032e25 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:18.151276 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045b7f-4a9a-42ed-bb3e-bc2787032e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:18.179104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:18.224850 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56045b7f-4a9a-42ed-bb3e-bc2787032e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:18.226321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56045b7f-4a9a-42ed-bb3e-bc2787032e25 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:18.335871 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 416/835] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:29:17 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:29:18.337596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978509-e286-4f69-aace-0ef11267552f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:18.366203 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:18.456688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978509-e286-4f69-aace-0ef11267552f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:18.501177 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:18.501818 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:18.502135 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:18.502406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:18.513387 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:18.515059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:18.531423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:18.532606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:18.533659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:18.533659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:18.533659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:18.533659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 420/836] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:18.538523 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56045b7f-4a9a-42ed-bb3e-bc2787032e25 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:18.603444 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:18.648459 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56045b7f-4a9a-42ed-bb3e-bc2787032e25 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:18.687126 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:18.687744 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:18.688019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:18.688286 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:18.688931 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:18.689232 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:18.690610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:18.702491 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 417/837] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:18.708418 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:18.796241 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:18.836346 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a81a5-202e-4e84-a7aa-5a07d3a227d6 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:18.874319 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:18.875216 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:18.875792 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:18.875972 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:18.884469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:18.886165 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:29:18.898338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:18.899545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:18.900642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 421/838] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:29:18.906145 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:19.030649 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7992d-4096-44fc-9cf3-d9453fb923c7 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:19.048938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:19.066817 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95dec6-9011-4999-a64e-482755bdc292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:19.067544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95dec6-9011-4999-a64e-482755bdc292 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:19.067881 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95dec6-9011-4999-a64e-482755bdc292 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:19.068214 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95dec6-9011-4999-a64e-482755bdc292 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:19.068973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95dec6-9011-4999-a64e-482755bdc292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:19.069274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95dec6-9011-4999-a64e-482755bdc292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:19.070713 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95dec6-9011-4999-a64e-482755bdc292 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:19.084278 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 418/839] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:19.091075 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:19.224276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3c59d-deea-4eec-8f36-61ce77d93583 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:19.260039 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:19.267438 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd77d4-0475-4429-8819-ee221258831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:19.271455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd77d4-0475-4429-8819-ee221258831c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:19.271455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd77d4-0475-4429-8819-ee221258831c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:19.271455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd77d4-0475-4429-8819-ee221258831c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:19.271455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd77d4-0475-4429-8819-ee221258831c None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=530e9c679e6041f491eb9a93a74cc118) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:19.271455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd77d4-0475-4429-8819-ee221258831c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:19.271455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd77d4-0475-4429-8819-ee221258831c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:19.277459 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 422/840] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:29:19 2022] GET /identity/v3/role_assignments?user.id=530e9c679e6041f491eb9a93a74cc118&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:21.473285 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e1330-d1b4-479f-9507-eff9781cc807 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:21.473885 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e1330-d1b4-479f-9507-eff9781cc807 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:21.473885 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e1330-d1b4-479f-9507-eff9781cc807 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:21.475209 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 419/841] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:21.480963 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6c67-4110-4648-8387-0779b016b2d6 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:21.481384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6c67-4110-4648-8387-0779b016b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:21.481514 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6c67-4110-4648-8387-0779b016b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:21.500480 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-09bb6c67-4110-4648-8387-0779b016b2d6 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:21.501662 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-09bb6c67-4110-4648-8387-0779b016b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:21.577353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 423/842] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:21.897811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e1330-d1b4-479f-9507-eff9781cc807 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:22.015393 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e1330-d1b4-479f-9507-eff9781cc807 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:22.053635 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96b3d-fc95-48a4-bb4b-f91ffe330004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:22.054267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96b3d-fc95-48a4-bb4b-f91ffe330004 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:22.054540 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96b3d-fc95-48a4-bb4b-f91ffe330004 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:22.054813 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96b3d-fc95-48a4-bb4b-f91ffe330004 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:22.065692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96b3d-fc95-48a4-bb4b-f91ffe330004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-90f96b3d-fc95-48a4-bb4b-f91ffe330004 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:29:22.070375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:22.071479 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:22.072543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 420/843] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:29:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:22.079058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb6c67-4110-4648-8387-0779b016b2d6 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:22.193042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb6c67-4110-4648-8387-0779b016b2d6 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:22.225431 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:22.237211 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:22.237827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:22.238113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:22.238367 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:22.239057 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] RBAC: Adding query filter params (name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:22.239362 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:22.240736 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:22.249037 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 424/844] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:22.255133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96b3d-fc95-48a4-bb4b-f91ffe330004 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:22.297692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:22.372341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96b3d-fc95-48a4-bb4b-f91ffe330004 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:22.414184 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:22.414818 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:22.415129 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:22.415402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:22.426959 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:22.428633 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:22.443304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:22.444277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:22.445213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:22.445213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:22.445213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:22.445213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 421/845] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:29:22.451158 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:22.566732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bfea3-accc-44f7-916d-03fc6fc90b16 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:22.605155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:22.605917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:22.606175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:22.606442 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:22.607162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:22.607504 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:22.608848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:22.624925 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 425/846] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:22.631282 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:22.732416 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:22.743808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686692-48ed-48c2-a1f0-db01c6368126 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:22.783830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:22.784464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:22.784759 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:22.785036 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:22.792384 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:22.793894 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:29:22.806856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:22.808078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:22.809661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 422/847] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:29:22.814506 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:22.873362 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:22.930689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0f472-2466-46fd-901d-ea594227292b None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:22.968664 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:22.969325 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:22.969682 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:22.969940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:22.970665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:22.970966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:22.972549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:22.991725 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 426/848] 10.222.0.69 () {56 vars in 1143 bytes} [Fri Aug 19 02:29:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:22.997814 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:23.108929 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6dd8e-8c02-4246-b4c3-7795b493d897 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:23.150233 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:23.151208 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:23.151496 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:23.151770 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:23.166086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:23.168130 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:23.187973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:23.189300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:23.190383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:23.190383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:23.190383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:23.190383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 423/849] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:23.195301 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:23.302299 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131ab0-6fd3-4654-95c5-e7e1cd6894d7 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:23.304634 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:23.336426 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:23.337030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:23.337301 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:23.337712 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:23.338361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:23.338785 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:23.340488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:23.353354 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 427/850] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:23.360089 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:23.362885 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:23.468123 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a0032-9c27-4842-a964-ecda2976d41e None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:23.504666 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:23.505305 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:23.505577 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:23.506090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:23.514806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:23.516653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:29:23.529536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:23.530787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:23.531787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 424/851] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:23.537334 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:23.655685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7dc6e-2028-4f95-84b5-876ef1aa6465 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:23.695170 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eccb56-87ee-4cad-9788-da9e3b87ed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:23.696142 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eccb56-87ee-4cad-9788-da9e3b87ed02 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:23.696590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eccb56-87ee-4cad-9788-da9e3b87ed02 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:23.696967 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eccb56-87ee-4cad-9788-da9e3b87ed02 None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:23.697703 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eccb56-87ee-4cad-9788-da9e3b87ed02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:23.698116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eccb56-87ee-4cad-9788-da9e3b87ed02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:23.700363 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eccb56-87ee-4cad-9788-da9e3b87ed02 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:23.717233 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 428/852] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:23.724062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:23.789495 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:23.848155 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ba5d-a453-45d5-adf4-ee4c08bd61e8 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:23.896430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0386cd-8b69-4230-9559-d8fef6c9bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:23.897346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0386cd-8b69-4230-9559-d8fef6c9bfe9 None admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:23.897737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0386cd-8b69-4230-9559-d8fef6c9bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:23.898228 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0386cd-8b69-4230-9559-d8fef6c9bfe9 None admin] PATH_INFO: `/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/530e9c679e6041f491eb9a93a74cc118/roles/b306a250d1614c329f4ac8c9b6dfbc58` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:23.914685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0386cd-8b69-4230-9559-d8fef6c9bfe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fce45fd90438a989865dcdda638f9, user_id=530e9c679e6041f491eb9a93a74cc118, role_id=b306a250d1614c329f4ac8c9b6dfbc58)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:23.916188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0386cd-8b69-4230-9559-d8fef6c9bfe9 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:23.937018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 425/853] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:29:23 2022] PUT /identity/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/530e9c679e6041f491eb9a93a74cc118/roles/b306a250d1614c329f4ac8c9b6dfbc58 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:29:26.178760 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca27de-a54b-4e83-ae91-a3bb26c237ee None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:26.179416 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca27de-a54b-4e83-ae91-a3bb26c237ee None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:26.179416 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca27de-a54b-4e83-ae91-a3bb26c237ee None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:26.181188 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 429/854] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:26.186552 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bab5a-7041-413c-b21b-1e6bf6ba35e3 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:26.187054 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bab5a-7041-413c-b21b-1e6bf6ba35e3 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:26.187172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bab5a-7041-413c-b21b-1e6bf6ba35e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:26.210859 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-3b6bab5a-7041-413c-b21b-1e6bf6ba35e3 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:26.212817 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-3b6bab5a-7041-413c-b21b-1e6bf6ba35e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:26.297361 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 426/855] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:26 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:29:26.693931 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca27de-a54b-4e83-ae91-a3bb26c237ee None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:26.722372 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:26.823803 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca27de-a54b-4e83-ae91-a3bb26c237ee None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:26.861342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ae15b-e2dd-4c52-9b82-62bc7f309eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:26.862050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae15b-e2dd-4c52-9b82-62bc7f309eb0 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:26.862318 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae15b-e2dd-4c52-9b82-62bc7f309eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:26.862722 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae15b-e2dd-4c52-9b82-62bc7f309eb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:26.874814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ae15b-e2dd-4c52-9b82-62bc7f309eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-649ae15b-e2dd-4c52-9b82-62bc7f309eb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:29:26.880338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:26.881379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:26.882214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 430/856] 10.222.0.69 () {56 vars in 1102 bytes} [Fri Aug 19 02:29:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:26.888419 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bab5a-7041-413c-b21b-1e6bf6ba35e3 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:26.944812 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:27.019569 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bab5a-7041-413c-b21b-1e6bf6ba35e3 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:27.058030 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:27.058720 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:27.058956 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:27.059261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:27.060080 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] RBAC: Adding query filter params (name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:27.060346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:27.061745 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:27.070072 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 427/857] 10.222.0.69 () {56 vars in 1103 bytes} [Fri Aug 19 02:29:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:27.077138 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ae15b-e2dd-4c52-9b82-62bc7f309eb0 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:27.173697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:27.192551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ae15b-e2dd-4c52-9b82-62bc7f309eb0 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:27.232973 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f544-3636-412f-969c-10a541de141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:27.233603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f544-3636-412f-969c-10a541de141c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:27.233876 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f544-3636-412f-969c-10a541de141c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:27.234189 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f544-3636-412f-969c-10a541de141c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:27.245068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8f544-3636-412f-969c-10a541de141c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:27.246841 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8f544-3636-412f-969c-10a541de141c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-33a8f544-3636-412f-969c-10a541de141c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:27.263155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:27.264468 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:27.272059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:27.272059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:27.272059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:27.272059 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 431/858] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:27.272405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:27.390830 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e75d41-309d-408a-a0af-bc2b4f762d2b None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:27.393676 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:27.434271 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:27.434884 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:27.435218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:27.435548 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:27.436263 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:27.436488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:27.437845 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:27.450835 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 428/859] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:27.456920 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f544-3636-412f-969c-10a541de141c None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:27.560834 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f544-3636-412f-969c-10a541de141c None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:27.594719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:27.595533 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:27.595909 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:27.596276 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:27.599399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:27.604998 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:27.606979 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:29:27.623140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:27.624313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:27.625853 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 432/860] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:27.630824 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:27.742401 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f125084-2e67-4e01-86d6-b44c004bd48d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:27.779328 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:27.779942 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:27.780212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:27.780477 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:27.781437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:27.781740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:27.783646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:27.803380 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 429/861] 10.222.0.69 () {56 vars in 1143 bytes} [Fri Aug 19 02:29:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:29:27.809502 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:27.945652 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78fb34-a9a6-4969-bc8a-7bad9ba9095a None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:27.987373 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7addf0d-0fce-49d3-bc0b-8295a79aed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:27.988148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7addf0d-0fce-49d3-bc0b-8295a79aed25 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:27.988424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7addf0d-0fce-49d3-bc0b-8295a79aed25 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:27.988800 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7addf0d-0fce-49d3-bc0b-8295a79aed25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:28.060681 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:28.069030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7addf0d-0fce-49d3-bc0b-8295a79aed25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:28.070644 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7addf0d-0fce-49d3-bc0b-8295a79aed25 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:28.187044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 433/862] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:29:27 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:29:28.193039 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:28.224693 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:28.319816 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccca213-8abb-4228-9ce2-7860e153732c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:28.362079 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:28.362741 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:28.363052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:28.363373 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:28.377035 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:28.378825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:28.399506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:28.400868 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:28.402265 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:28.402265 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:28.402265 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:28.402265 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 430/863] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:28.410274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7addf0d-0fce-49d3-bc0b-8295a79aed25 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:28.519766 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:28.526160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7addf0d-0fce-49d3-bc0b-8295a79aed25 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:28.568503 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:28.569112 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:28.569380 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:28.569640 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:28.570275 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:28.570568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:28.571959 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:28.584890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 434/864] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:28.591246 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:28.678803 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:28.706398 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c290c5-ab69-41d9-ba43-0672e6433827 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:28.745543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:28.746235 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:28.746507 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:28.746783 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:28.755992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:28.757653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:29:28.773409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:28.774754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:28.775875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 431/865] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:28.782465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:28.913817 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75f82-2b75-47e9-9319-3bf18a35c2e6 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:28.957616 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88555e75-606f-4001-bf9b-ed3203796f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:28.958264 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88555e75-606f-4001-bf9b-ed3203796f9c None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:28.958537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88555e75-606f-4001-bf9b-ed3203796f9c None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:28.958804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88555e75-606f-4001-bf9b-ed3203796f9c None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:28.959524 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88555e75-606f-4001-bf9b-ed3203796f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:28.959827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88555e75-606f-4001-bf9b-ed3203796f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:28.961423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88555e75-606f-4001-bf9b-ed3203796f9c None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:28.975319 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 435/866] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:28.982612 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:29.102910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8d112-69c0-49c3-ba2d-aee00fb7f92f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:29.146758 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873df9dc-3f7c-4a3c-9b46-1a305a2c79b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:29.147404 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873df9dc-3f7c-4a3c-9b46-1a305a2c79b3 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:29.147683 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873df9dc-3f7c-4a3c-9b46-1a305a2c79b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:29.147955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873df9dc-3f7c-4a3c-9b46-1a305a2c79b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:29.148912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873df9dc-3f7c-4a3c-9b46-1a305a2c79b3 None admin] RBAC: Adding query filter params (role.id=b306a250d1614c329f4ac8c9b6dfbc58, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=530e9c679e6041f491eb9a93a74cc118) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:29.149250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873df9dc-3f7c-4a3c-9b46-1a305a2c79b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:29.150927 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873df9dc-3f7c-4a3c-9b46-1a305a2c79b3 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:29.153267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:29.160439 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 432/867] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:29:28 2022] GET /identity/v3/role_assignments?user.id=530e9c679e6041f491eb9a93a74cc118&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=b306a250d1614c329f4ac8c9b6dfbc58 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:31.751774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b5fe3-ab9a-451c-b5cb-4d8dbe526f28 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:31.752384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b5fe3-ab9a-451c-b5cb-4d8dbe526f28 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:31.752384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b5fe3-ab9a-451c-b5cb-4d8dbe526f28 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:31.754183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 436/868] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:31.760505 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8733b-0a58-4bdf-a033-6f3ee7b25aae None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:31.761002 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8733b-0a58-4bdf-a033-6f3ee7b25aae None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:31.761083 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8733b-0a58-4bdf-a033-6f3ee7b25aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:31.781697 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-54f8733b-0a58-4bdf-a033-6f3ee7b25aae None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:31.782902 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-54f8733b-0a58-4bdf-a033-6f3ee7b25aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:31.864068 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 433/869] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:31 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:32.223760 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b5fe3-ab9a-451c-b5cb-4d8dbe526f28 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:32.246109 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:32.359671 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b5fe3-ab9a-451c-b5cb-4d8dbe526f28 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:32.397814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885cc2-b080-4f10-98d6-d474046749db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:32.398457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885cc2-b080-4f10-98d6-d474046749db None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:32.398725 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885cc2-b080-4f10-98d6-d474046749db None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:32.398989 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885cc2-b080-4f10-98d6-d474046749db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:32.409277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885cc2-b080-4f10-98d6-d474046749db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-2c885cc2-b080-4f10-98d6-d474046749db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:29:32.413945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:32.415332 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:32.416393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 437/870] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:29:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:29:32.421782 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8733b-0a58-4bdf-a033-6f3ee7b25aae None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:32.528145 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8733b-0a58-4bdf-a033-6f3ee7b25aae None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:32.559682 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:32.569031 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:32.569731 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:32.570038 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:32.570357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:32.571174 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:32.571510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:32.572909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:32.583832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 434/871] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:29:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:32.590566 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885cc2-b080-4f10-98d6-d474046749db None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:32.672124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:32.699952 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885cc2-b080-4f10-98d6-d474046749db None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:32.740852 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:32.741531 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:32.741823 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:32.742168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:32.752881 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:32.754328 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:32.769814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:32.771090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:32.772606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:32.772606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:32.772606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:32.772606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 438/872] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:32.777424 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:32.904970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f30e4-0df6-483b-832f-d2c6aa5c2d52 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:32.945385 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:32.946042 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:32.946405 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:32.946655 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:32.947493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:32.947794 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:32.949510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:32.970245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 435/873] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:29:32.971547 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:33.080172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0cfc3-01e1-4b60-9e14-a287479bdbbf None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:33.108457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:33.117550 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:33.118185 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:33.118458 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:33.118725 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:33.128230 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:33.129985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:29:33.142720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:33.143888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:33.145399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 439/874] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:33.150781 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:33.210498 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:33.266095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40507c09-2ac8-4b4b-8cd1-426571adc692 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:33.304522 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:33.305123 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:33.305396 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:33.305660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:33.306492 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:33.306799 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:33.308298 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:33.327149 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 436/875] 10.222.0.69 () {56 vars in 1143 bytes} [Fri Aug 19 02:29:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:33.333160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:33.454790 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf9ae2-32e0-4aeb-b804-937d02c8876d None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:33.493473 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bfdc2-9404-4b31-bb41-c80f40947740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:33.493999 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bfdc2-9404-4b31-bb41-c80f40947740 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:33.494274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bfdc2-9404-4b31-bb41-c80f40947740 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:33.494540 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bfdc2-9404-4b31-bb41-c80f40947740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:33.558547 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:33.572837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bfdc2-9404-4b31-bb41-c80f40947740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:33.574344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bfdc2-9404-4b31-bb41-c80f40947740 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:33.689082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 440/876] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:29:33 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:29:33.695379 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:33.811383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199d4d5-ffe0-42e4-a476-8a11007ff6eb None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:33.821913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:33.853599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:33.854302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:33.854611 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:33.854883 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:33.866419 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:33.867949 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:33.884261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:33.885360 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:33.886313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:33.886313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:33.886313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:33.886313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 437/877] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:33.891905 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bfdc2-9404-4b31-bb41-c80f40947740 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:33.982432 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:33.995030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bfdc2-9404-4b31-bb41-c80f40947740 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:34.029558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:34.030194 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:34.030440 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:34.030746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:34.031597 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:34.031851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:34.033261 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:34.044946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 441/878] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:34.050912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:34.156147 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f238703-ff97-4e20-8a77-b7c3f9bdb78f None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:34.191270 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:34.191901 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:34.192185 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:34.192447 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:34.199203 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:34.200657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:29:34.211628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:34.212686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:34.214918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 438/879] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:34.223238 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:34.326215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16417b47-5e86-4873-bd5e-47714b328377 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:34.365666 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6372-4c7f-4a88-98d7-5c61ae2a3df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:34.366455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6372-4c7f-4a88-98d7-5c61ae2a3df1 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:34.366852 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6372-4c7f-4a88-98d7-5c61ae2a3df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:34.367179 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6372-4c7f-4a88-98d7-5c61ae2a3df1 None admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:34.368303 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a6372-4c7f-4a88-98d7-5c61ae2a3df1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:34.368728 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a6372-4c7f-4a88-98d7-5c61ae2a3df1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:34.371162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a6372-4c7f-4a88-98d7-5c61ae2a3df1 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:34.386243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 442/880] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:34.393720 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:34.426649 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:34.548554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fa16e-e1bb-42b5-bb71-ca860187aea8 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:34.587396 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306097a-51d0-46db-b422-5f6ab102cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:34.587915 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306097a-51d0-46db-b422-5f6ab102cd59 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:34.588191 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306097a-51d0-46db-b422-5f6ab102cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:34.588451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306097a-51d0-46db-b422-5f6ab102cd59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:34.589513 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306097a-51d0-46db-b422-5f6ab102cd59 None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=530e9c679e6041f491eb9a93a74cc118) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:34.589808 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306097a-51d0-46db-b422-5f6ab102cd59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:34.591310 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306097a-51d0-46db-b422-5f6ab102cd59 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:34.596734 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 439/881] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:29:34 2022] GET /identity/v3/role_assignments?user.id=530e9c679e6041f491eb9a93a74cc118&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=22d22ddee1804d668628115534a289ab => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:36.730265 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a4eed-dbb0-45ed-bfa5-ccd29974bd45 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:36.730857 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a4eed-dbb0-45ed-bfa5-ccd29974bd45 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:36.730857 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a4eed-dbb0-45ed-bfa5-ccd29974bd45 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:36.732249 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 443/882] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:36.738764 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbaaa9-2bee-4d5e-a7cd-abed51bb5ab3 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:36.739531 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbaaa9-2bee-4d5e-a7cd-abed51bb5ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:36.739677 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbaaa9-2bee-4d5e-a7cd-abed51bb5ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:36.766399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-d7fbaaa9-2bee-4d5e-a7cd-abed51bb5ab3 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:36.768203 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-d7fbaaa9-2bee-4d5e-a7cd-abed51bb5ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:36.849810 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 440/883] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:36 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:37.168019 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a4eed-dbb0-45ed-bfa5-ccd29974bd45 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:37.180636 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:37.286843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a4eed-dbb0-45ed-bfa5-ccd29974bd45 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:37.327884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321b59-a16e-4250-9013-93858eb25464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:37.328392 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321b59-a16e-4250-9013-93858eb25464 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:37.328635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321b59-a16e-4250-9013-93858eb25464 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:37.329024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321b59-a16e-4250-9013-93858eb25464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:37.344343 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e321b59-a16e-4250-9013-93858eb25464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-5e321b59-a16e-4250-9013-93858eb25464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:29:37.350082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:37.351115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:37.351981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 444/884] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:37.358215 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbaaa9-2bee-4d5e-a7cd-abed51bb5ab3 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:37.376128 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:37.471407 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbaaa9-2bee-4d5e-a7cd-abed51bb5ab3 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:37.513063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:37.514048 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:37.514478 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:37.514893 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:37.515753 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:37.516099 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:37.518285 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:37.530177 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 441/885] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:37.536230 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321b59-a16e-4250-9013-93858eb25464 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:37.602485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:37.638620 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321b59-a16e-4250-9013-93858eb25464 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:37.680474 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:37.681360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:37.681717 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:37.682093 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:37.699837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:37.701506 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:37.716208 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:37.717348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:37.718505 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:37.718505 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:37.718505 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:37.718505 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 445/886] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:37.723497 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:37.805040 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:37.828303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d7ea9-9728-4238-bdc8-f0148e2ff097 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:37.865252 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:37.865865 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:37.866135 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:37.866397 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:37.867066 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:37.867366 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:37.868747 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:37.880825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 442/887] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:37.887586 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:37.996720 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6434-4d6c-45f1-805c-546bed964db3 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:38.016924 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:38.035614 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:38.036241 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:38.036514 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:38.036788 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:38.044572 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:38.046013 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:29:38.057232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:38.058359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:38.059976 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 446/888] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:38.065613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:38.192193 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a133316-acdd-449e-ad1b-ca9ae22d2608 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:38.235176 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:38.235990 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:38.236274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:38.236628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:38.237742 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:38.238179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:38.240464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:38.244849 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:38.261858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 443/889] 10.222.0.69 () {56 vars in 1143 bytes} [Fri Aug 19 02:29:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:38.268300 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:38.384242 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb826dd-0cac-4485-a5a5-fd12f2665c36 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:38.419532 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:38.420192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:38.420457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:38.420719 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:38.431498 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:38.432938 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:38.447204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:38.448274 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:38.449348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:38.449348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:38.449348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:38.449348 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 447/890] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:38.455851 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:38.569806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216d9c1-bf9c-4a14-96bb-132622b08c63 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:38.605100 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:38.605704 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:38.605976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:38.606245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:38.606888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:38.607298 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:38.608779 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:38.621266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 444/891] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:38.629507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:38.663831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:38.740785 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09ff9-c011-4532-a6af-fdaf07f8156a None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:38.774781 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:38.775445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:38.775718 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:38.775979 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:38.783186 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:38.784619 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:29:38.796369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:38.797287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:38.798205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 448/892] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:29:38.804760 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:38.871580 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:38.923767 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590ccdf-7ee0-4c7a-83e7-d0757dcf6f25 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:38.964399 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53577c92-01b1-49e5-ae91-390828d62785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:38.964993 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53577c92-01b1-49e5-ae91-390828d62785 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:38.965266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53577c92-01b1-49e5-ae91-390828d62785 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:38.965528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53577c92-01b1-49e5-ae91-390828d62785 None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:38.966203 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53577c92-01b1-49e5-ae91-390828d62785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:38.966508 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53577c92-01b1-49e5-ae91-390828d62785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:38.967995 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53577c92-01b1-49e5-ae91-390828d62785 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:38.980395 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 445/893] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:38.990275 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:39.089607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:39.099136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f519c-751c-46ed-b76f-a2662aec6e51 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:39.138028 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44d697-32b1-4b22-9927-85749dd389d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:39.138614 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d697-32b1-4b22-9927-85749dd389d5 None admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:39.138950 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d697-32b1-4b22-9927-85749dd389d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:39.139221 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d697-32b1-4b22-9927-85749dd389d5 None admin] PATH_INFO: `/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/530e9c679e6041f491eb9a93a74cc118/roles/22d22ddee1804d668628115534a289ab` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:39.141412 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44d697-32b1-4b22-9927-85749dd389d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fce45fd90438a989865dcdda638f9, user_id=530e9c679e6041f491eb9a93a74cc118, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:39.142834 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44d697-32b1-4b22-9927-85749dd389d5 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:39.158207 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 449/894] 10.222.0.69 () {58 vars in 1439 bytes} [Fri Aug 19 02:29:38 2022] PUT /identity/v3/projects/ba3fce45fd90438a989865dcdda638f9/users/530e9c679e6041f491eb9a93a74cc118/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:29:41.296466 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedda316-2035-4e5a-9050-b0cd2456c4d6 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:41.297363 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedda316-2035-4e5a-9050-b0cd2456c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:41.297363 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedda316-2035-4e5a-9050-b0cd2456c4d6 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:41.299639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 446/895] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:41.308542 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40c409-aca4-49da-a9b2-eb8462ffe79f None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:41.309309 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40c409-aca4-49da-a9b2-eb8462ffe79f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:41.309462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40c409-aca4-49da-a9b2-eb8462ffe79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:41.329598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-5c40c409-aca4-49da-a9b2-eb8462ffe79f None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:41.330794 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-5c40c409-aca4-49da-a9b2-eb8462ffe79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:41.414823 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 450/896] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:41 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:41.754877 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedda316-2035-4e5a-9050-b0cd2456c4d6 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:41.892292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedda316-2035-4e5a-9050-b0cd2456c4d6 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:41.906944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:41.937006 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b8cc-0e67-4836-a012-0f6f495e3a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:41.937635 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b8cc-0e67-4836-a012-0f6f495e3a37 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:41.937914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b8cc-0e67-4836-a012-0f6f495e3a37 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:41.938183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b8cc-0e67-4836-a012-0f6f495e3a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:41.948489 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325b8cc-0e67-4836-a012-0f6f495e3a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-e325b8cc-0e67-4836-a012-0f6f495e3a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:29:41.953188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:41.954353 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:41.955595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 447/897] 10.222.0.69 () {56 vars in 1096 bytes} [Fri Aug 19 02:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:41.960539 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40c409-aca4-49da-a9b2-eb8462ffe79f None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:42.044767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:42.064528 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40c409-aca4-49da-a9b2-eb8462ffe79f None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:42.098846 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:42.099492 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:42.099764 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:42.100028 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:42.100686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:42.100985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:42.102360 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:42.110548 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 451/898] 10.222.0.69 () {56 vars in 1099 bytes} [Fri Aug 19 02:29:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:29:42.117326 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b8cc-0e67-4836-a012-0f6f495e3a37 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:42.239167 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b8cc-0e67-4836-a012-0f6f495e3a37 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:42.274032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:42.274638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:42.274908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:42.275212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:42.285951 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:42.287417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:42.302535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:42.304082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:42.305164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:42.305164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:42.305164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:42.305164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 448/899] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:42.310321 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:42.421302 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20ecff-3720-4a11-ad09-dc06d3c37921 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:42.457804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:42.458408 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:42.458684 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:42.458984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:42.459659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:42.459961 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:42.461350 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:42.473570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 452/900] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:42.482817 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:42.511762 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:42.588348 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1af69-a654-44f9-8174-dd6eb5bb4e5d None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:42.624235 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:42.624847 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:42.625116 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:42.625379 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:42.636218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:42.638433 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:29:42.649672 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:42.650765 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:42.651775 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 449/901] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:42.657215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:42.661373 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:42.763386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffa89c-6c9c-44f2-a2d4-5f4c482cee7f None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:42.815232 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:42.815848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:42.816121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:42.816387 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:42.817106 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:42.817408 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:42.818856 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:42.837803 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 453/902] 10.222.0.69 () {56 vars in 1143 bytes} [Fri Aug 19 02:29:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:42.844954 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:42.969657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:42.991759 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0ec6-08e3-4fbd-b214-e363c7407759 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:43.028562 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c87cc7-9d78-4b3b-afc6-3e438e3e0fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:43.029164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c87cc7-9d78-4b3b-afc6-3e438e3e0fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:43.029462 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c87cc7-9d78-4b3b-afc6-3e438e3e0fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:43.029731 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c87cc7-9d78-4b3b-afc6-3e438e3e0fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:43.097511 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c87cc7-9d78-4b3b-afc6-3e438e3e0fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:43.098904 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c87cc7-9d78-4b3b-afc6-3e438e3e0fd4 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:43.186832 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:43.203678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 450/903] 10.222.0.69 () {58 vars in 1282 bytes} [Fri Aug 19 02:29:42 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:29:43.210021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:43.281136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:43.322834 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96440e6-06f8-4e4c-862a-4278e0d4b805 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:43.358072 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:43.358620 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:43.358890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:43.359183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:43.369615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:43.371105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:29:43.385562 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:43.386598 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:29:43.387629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:29:43.387629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:29:43.387629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:43.387629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 454/904] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:43.392994 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c87cc7-9d78-4b3b-afc6-3e438e3e0fd4 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:43.499386 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c87cc7-9d78-4b3b-afc6-3e438e3e0fd4 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:43.532622 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:43.533210 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:43.533486 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:43.533751 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:43.534381 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:43.534679 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:43.536083 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:43.547468 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 451/905] 10.222.0.69 () {56 vars in 1109 bytes} [Fri Aug 19 02:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:43.556465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:43.680729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f19b9-f2f6-46e9-b1b9-ec012bb799bf None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:43.697632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:43.720359 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:43.720985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:43.721259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:43.721525 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:43.728149 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:43.729595 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:29:43.740813 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:43.741795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: ERROR keystone.server.flask.application Aug 19 02:29:43.743025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 455/906] 10.222.0.69 () {56 vars in 1111 bytes} [Fri Aug 19 02:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:43.750659 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:43.804362 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:43.861262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690eec-e5a8-4990-a18a-a0ecbbb6445c None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:43.899663 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ec482-2a43-4631-9617-e79c88cb51fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:43.900270 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec482-2a43-4631-9617-e79c88cb51fa None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:43.900544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec482-2a43-4631-9617-e79c88cb51fa None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:43.900818 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec482-2a43-4631-9617-e79c88cb51fa None admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:43.901502 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec482-2a43-4631-9617-e79c88cb51fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:43.901810 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec482-2a43-4631-9617-e79c88cb51fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:43.903277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec482-2a43-4631-9617-e79c88cb51fa None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:43.915245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 452/907] 10.222.0.69 () {56 vars in 1148 bytes} [Fri Aug 19 02:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:43.922369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:44.046087 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd15cb6-4564-4275-8708-25c3c44af078 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:44.081981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efba0a-a9af-4e24-8195-775b661dca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:44.082575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efba0a-a9af-4e24-8195-775b661dca48 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:44.082848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efba0a-a9af-4e24-8195-775b661dca48 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:44.083157 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efba0a-a9af-4e24-8195-775b661dca48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:44.083867 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efba0a-a9af-4e24-8195-775b661dca48 None admin] RBAC: Adding query filter params (role.id=22d22ddee1804d668628115534a289ab, scope.project.id=ba3fce45fd90438a989865dcdda638f9, user.id=530e9c679e6041f491eb9a93a74cc118) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:44.084170 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efba0a-a9af-4e24-8195-775b661dca48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:44.085587 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efba0a-a9af-4e24-8195-775b661dca48 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:44.091744 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 456/908] 10.222.0.69 () {56 vars in 1374 bytes} [Fri Aug 19 02:29:43 2022] GET /identity/v3/role_assignments?user.id=530e9c679e6041f491eb9a93a74cc118&scope.project.id=ba3fce45fd90438a989865dcdda638f9&role.id=22d22ddee1804d668628115534a289ab => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:46.251364 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8577-7b96-48c9-8fae-c6bc9577f580 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:46.251925 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8577-7b96-48c9-8fae-c6bc9577f580 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:46.251925 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8577-7b96-48c9-8fae-c6bc9577f580 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:46.253218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 453/909] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:46.259534 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b74e-c7c4-4e5f-b4c0-32241c91841a None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:46.260219 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b74e-c7c4-4e5f-b4c0-32241c91841a None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:46.260448 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b74e-c7c4-4e5f-b4c0-32241c91841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:46.287215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-1113b74e-c7c4-4e5f-b4c0-32241c91841a None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:46.288439 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-1113b74e-c7c4-4e5f-b4c0-32241c91841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:46.322469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:46.365834 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 457/910] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:46.695077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf8577-7b96-48c9-8fae-c6bc9577f580 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:46.807348 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf8577-7b96-48c9-8fae-c6bc9577f580 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:46.814894 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:46.843318 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:46.843953 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:46.844199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:46.845608 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] PATH_INFO: `/v3/services/placement` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:46.845608 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:46.846509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:46.855290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:46.856510 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:46.857930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 454/911] 10.222.0.69 () {56 vars in 1117 bytes} [Fri Aug 19 02:29:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:46.866155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113b74e-c7c4-4e5f-b4c0-32241c91841a None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:46.976673 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113b74e-c7c4-4e5f-b4c0-32241c91841a None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:47.014385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95065d50-7020-47d2-8150-7e0060269bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:47.015189 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065d50-7020-47d2-8150-7e0060269bac None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:47.015463 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065d50-7020-47d2-8150-7e0060269bac None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:47.015724 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95065d50-7020-47d2-8150-7e0060269bac None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:47.016411 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95065d50-7020-47d2-8150-7e0060269bac None admin] RBAC: Adding query filter params (name=placement) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:47.016826 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95065d50-7020-47d2-8150-7e0060269bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:47.018303 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95065d50-7020-47d2-8150-7e0060269bac None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:47.023306 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 458/912] 10.222.0.69 () {56 vars in 1116 bytes} [Fri Aug 19 02:29:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:47.032482 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:47.169029 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625259a-8d4f-4a0b-873b-428687291aaa None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:47.206778 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5328845-05d3-48ff-857d-a93c0cc0c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:47.207787 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5328845-05d3-48ff-857d-a93c0cc0c529 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:47.208248 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5328845-05d3-48ff-857d-a93c0cc0c529 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:47.208696 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5328845-05d3-48ff-857d-a93c0cc0c529 None admin] PATH_INFO: `/v3/services` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:47.209725 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5328845-05d3-48ff-857d-a93c0cc0c529 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:47.210226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5328845-05d3-48ff-857d-a93c0cc0c529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:47.212472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5328845-05d3-48ff-857d-a93c0cc0c529 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:47.219760 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 455/913] 10.222.0.69 () {56 vars in 1116 bytes} [Fri Aug 19 02:29:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:49.357193 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964677b4-75d1-4333-acd5-9356f29361f7 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:49.358045 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964677b4-75d1-4333-acd5-9356f29361f7 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:49.358045 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964677b4-75d1-4333-acd5-9356f29361f7 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:49.362070 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 459/914] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:49.370180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caff3c-1cb7-4705-bbe8-b6285ab9b936 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:49.370954 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caff3c-1cb7-4705-bbe8-b6285ab9b936 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:49.371587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caff3c-1cb7-4705-bbe8-b6285ab9b936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:49.400060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-e8caff3c-1cb7-4705-bbe8-b6285ab9b936 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:49.401416 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-e8caff3c-1cb7-4705-bbe8-b6285ab9b936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:49.444573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:49.490118 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 456/915] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:49.810418 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964677b4-75d1-4333-acd5-9356f29361f7 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:49.843552 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:49.919789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964677b4-75d1-4333-acd5-9356f29361f7 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:49.958970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb759091-f5cd-42f6-a0f8-5603ff2a29ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:49.959601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759091-f5cd-42f6-a0f8-5603ff2a29ee None admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:49.959881 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759091-f5cd-42f6-a0f8-5603ff2a29ee None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:49.960145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759091-f5cd-42f6-a0f8-5603ff2a29ee None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:49.960770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759091-f5cd-42f6-a0f8-5603ff2a29ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:49.962168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759091-f5cd-42f6-a0f8-5603ff2a29ee None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:49.983647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 460/916] 10.222.0.69 () {60 vars in 1141 bytes} [Fri Aug 19 02:29:49 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:29:52.230297 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a02c1-e885-47be-a007-3021ed6a9724 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:52.231124 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a02c1-e885-47be-a007-3021ed6a9724 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:52.231220 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a02c1-e885-47be-a007-3021ed6a9724 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:52.232812 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 457/917] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:52.239460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187233d-1be1-4ec9-8eae-0497320d59e2 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:52.240089 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187233d-1be1-4ec9-8eae-0497320d59e2 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:52.240089 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187233d-1be1-4ec9-8eae-0497320d59e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:52.260902 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-0187233d-1be1-4ec9-8eae-0497320d59e2 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:52.262129 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-0187233d-1be1-4ec9-8eae-0497320d59e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:52.351084 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 461/918] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:52 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:29:52.701634 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a02c1-e885-47be-a007-3021ed6a9724 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:52.850446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a02c1-e885-47be-a007-3021ed6a9724 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:52.892911 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:52.893572 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:52.893843 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:52.894108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:52.894685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:52.896108 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:52.905521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:52.906717 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:52.907837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 458/919] 10.222.0.69 () {56 vars in 1117 bytes} [Fri Aug 19 02:29:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:52.914689 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187233d-1be1-4ec9-8eae-0497320d59e2 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:52.934522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:53.032046 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187233d-1be1-4ec9-8eae-0497320d59e2 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:53.068920 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:53.069536 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:53.069814 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:53.070082 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:53.070713 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:53.071050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:53.072433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:53.078002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 462/920] 10.222.0.69 () {56 vars in 1116 bytes} [Fri Aug 19 02:29:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:53.084250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:53.114463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:53.204023 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e6b53-bc7c-4f27-b687-d26db6f7d662 None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:53.251077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439143-857f-44ec-a62c-ee98504bae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:53.251759 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439143-857f-44ec-a62c-ee98504bae64 None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:53.251959 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439143-857f-44ec-a62c-ee98504bae64 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:53.252219 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439143-857f-44ec-a62c-ee98504bae64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:53.252908 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439143-857f-44ec-a62c-ee98504bae64 None admin] RBAC: Adding query filter params (interface=public, service_id=bb8b7874f7a04974a45259e00dd8ecf5, region_id=RegionOne) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:53.253236 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439143-857f-44ec-a62c-ee98504bae64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:53.255123 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439143-857f-44ec-a62c-ee98504bae64 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:53.261867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 459/921] 10.222.0.69 () {56 vars in 1251 bytes} [Fri Aug 19 02:29:53 2022] GET /identity/v3/endpoints?service_id=bb8b7874f7a04974a45259e00dd8ecf5&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:53.268116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:53.362044 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:53.384494 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd0f3-d8dc-4f3f-8d6b-456b3ea408f9 None admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:53.421243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e9e35-c655-4846-b8c2-d9bf04e84fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:53.421841 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e9e35-c655-4846-b8c2-d9bf04e84fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:53.422109 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e9e35-c655-4846-b8c2-d9bf04e84fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:53.422376 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e9e35-c655-4846-b8c2-d9bf04e84fb6 None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:53.423015 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e9e35-c655-4846-b8c2-d9bf04e84fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:53.424384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e9e35-c655-4846-b8c2-d9bf04e84fb6 None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:53.432308 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 463/922] 10.222.0.69 () {56 vars in 1087 bytes} [Fri Aug 19 02:29:53 2022] GET /identity/v3/services => generated 1962 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:29:55.626294 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e26e-6bb5-4900-82a2-5604f6178b15 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:55.626844 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e26e-6bb5-4900-82a2-5604f6178b15 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:55.627018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e26e-6bb5-4900-82a2-5604f6178b15 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:55.628686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 460/923] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:29:55.637043 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2028c-8e61-4aad-a3e5-752304e44739 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:55.637586 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2028c-8e61-4aad-a3e5-752304e44739 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:55.637699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2028c-8e61-4aad-a3e5-752304e44739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:55.662519 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-19b2028c-8e61-4aad-a3e5-752304e44739 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:55.664226 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-19b2028c-8e61-4aad-a3e5-752304e44739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:55.744617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 464/924] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:29:55 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:29:56.074796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38e26e-6bb5-4900-82a2-5604f6178b15 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:56.194590 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:56.206350 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38e26e-6bb5-4900-82a2-5604f6178b15 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:56.247332 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:56.248027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:56.248279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:56.248566 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:56.249133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:56.250494 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:29:56.259650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:29:56.260795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application with Lock( Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: ERROR keystone.server.flask.application Aug 19 02:29:56.261909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 461/925] 10.222.0.69 () {56 vars in 1117 bytes} [Fri Aug 19 02:29:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:29:56.267907 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2028c-8e61-4aad-a3e5-752304e44739 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:56.362589 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:56.388256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2028c-8e61-4aad-a3e5-752304e44739 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:56.428768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e5a19-2320-43ea-adda-7175f877672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:56.429386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5a19-2320-43ea-adda-7175f877672a None admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:56.429687 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5a19-2320-43ea-adda-7175f877672a None admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:56.429913 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5a19-2320-43ea-adda-7175f877672a None admin] PATH_INFO: `/v3/services` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:56.430537 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e5a19-2320-43ea-adda-7175f877672a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:29:56.430829 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e5a19-2320-43ea-adda-7175f877672a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:56.432233 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e5a19-2320-43ea-adda-7175f877672a None admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:56.437733 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 465/926] 10.222.0.69 () {56 vars in 1116 bytes} [Fri Aug 19 02:29:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:29:56.445930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:56.561179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc12b-cd71-44bd-a32a-c9c9b35b75fe None admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:56.601394 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798d69e-9160-4e53-8d95-6ecffd040e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:56.601992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798d69e-9160-4e53-8d95-6ecffd040e57 None admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:56.602258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798d69e-9160-4e53-8d95-6ecffd040e57 None admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:56.602526 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798d69e-9160-4e53-8d95-6ecffd040e57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:56.603221 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798d69e-9160-4e53-8d95-6ecffd040e57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:56.604582 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798d69e-9160-4e53-8d95-6ecffd040e57 None admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:56.632342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 462/927] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:29:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:30:06.434554 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=30 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:30:06.627869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:30:58.331052 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659fad8-0be0-413e-a451-b6817b0c245b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:58.332024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659fad8-0be0-413e-a451-b6817b0c245b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:58.332499 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659fad8-0be0-413e-a451-b6817b0c245b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:58.334054 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 466/928] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:30:58.339903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15574b-25ba-4aef-9a1e-98bc4a3b94be None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:58.340342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15574b-25ba-4aef-9a1e-98bc4a3b94be None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:58.340684 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15574b-25ba-4aef-9a1e-98bc4a3b94be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:58.372370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-fe15574b-25ba-4aef-9a1e-98bc4a3b94be None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:30:58.374609 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-fe15574b-25ba-4aef-9a1e-98bc4a3b94be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:30:58.463047 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 463/929] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:30:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:30:58.817214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488dee9-6848-4356-85a6-d37c2736dfab None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:58.817708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488dee9-6848-4356-85a6-d37c2736dfab None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:58.818063 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488dee9-6848-4356-85a6-d37c2736dfab None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:58.819833 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 467/930] 10.222.0.69 () {54 vars in 965 bytes} [Fri Aug 19 02:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:30:58.826197 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcde3e-8eeb-4fc6-ba72-7b9480c865df None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:58.826516 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcde3e-8eeb-4fc6-ba72-7b9480c865df None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:58.826861 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcde3e-8eeb-4fc6-ba72-7b9480c865df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:58.903227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-addcde3e-8eeb-4fc6-ba72-7b9480c865df None None] MFA Rules not processed for user `69dafc33dd0d4f85822f8d54af542ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:30:58.904281 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-addcde3e-8eeb-4fc6-ba72-7b9480c865df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:30:58.973408 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 464/931] 10.222.0.69 () {58 vars in 1062 bytes} [Fri Aug 19 02:30:58 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:30:58.982175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488dee9-6848-4356-85a6-d37c2736dfab None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:58.993202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488dee9-6848-4356-85a6-d37c2736dfab None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:58.996649 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b410624-2b6c-4233-a72a-a48b29a4d1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:58.997243 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b410624-2b6c-4233-a72a-a48b29a4d1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:58.997893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b410624-2b6c-4233-a72a-a48b29a4d1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:58.997893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b410624-2b6c-4233-a72a-a48b29a4d1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:59.007080 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b410624-2b6c-4233-a72a-a48b29a4d1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:59.008514 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b410624-2b6c-4233-a72a-a48b29a4d1c5 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:59.017908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 468/932] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:30:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:01.546177 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c4e52-62db-4ed3-a0ba-6976d525141b None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:01.546811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c4e52-62db-4ed3-a0ba-6976d525141b None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:01.546811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c4e52-62db-4ed3-a0ba-6976d525141b None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:01.548082 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 465/933] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:01.554035 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26bdaa-87d6-4f7d-bbd8-9649320e03c7 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:01.554612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26bdaa-87d6-4f7d-bbd8-9649320e03c7 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:01.554612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26bdaa-87d6-4f7d-bbd8-9649320e03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:01.575449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-1e26bdaa-87d6-4f7d-bbd8-9649320e03c7 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:01.576698 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-1e26bdaa-87d6-4f7d-bbd8-9649320e03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:01.585200 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 469/934] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:01.934911 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331fcbd-68e9-4718-be7e-fc42e2ebbb3b None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:01.935312 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331fcbd-68e9-4718-be7e-fc42e2ebbb3b None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:01.935542 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331fcbd-68e9-4718-be7e-fc42e2ebbb3b None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:01.936888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 466/935] 10.222.0.69 () {54 vars in 965 bytes} [Fri Aug 19 02:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:01.942957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cccac9-a2cf-4a00-8e8c-f53fe9436a1e None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:01.943283 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cccac9-a2cf-4a00-8e8c-f53fe9436a1e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:01.943549 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cccac9-a2cf-4a00-8e8c-f53fe9436a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:01.963659 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-22cccac9-a2cf-4a00-8e8c-f53fe9436a1e None None] MFA Rules not processed for user `69dafc33dd0d4f85822f8d54af542ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:01.964848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-22cccac9-a2cf-4a00-8e8c-f53fe9436a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:01.971493 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 470/936] 10.222.0.69 () {58 vars in 1062 bytes} [Fri Aug 19 02:31:01 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:01.980402 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331fcbd-68e9-4718-be7e-fc42e2ebbb3b None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:01.992792 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331fcbd-68e9-4718-be7e-fc42e2ebbb3b None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:01.996528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bc64f-0038-4b2c-a3a7-a15e8341646b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:01.997170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc64f-0038-4b2c-a3a7-a15e8341646b service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:01.997450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc64f-0038-4b2c-a3a7-a15e8341646b service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:01.997720 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bc64f-0038-4b2c-a3a7-a15e8341646b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:02.007943 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bc64f-0038-4b2c-a3a7-a15e8341646b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:02.009394 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bc64f-0038-4b2c-a3a7-a15e8341646b service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:02.019473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 467/937] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:04.756187 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd422-ef54-4fd0-a039-517e84918eb0 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:04.756729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd422-ef54-4fd0-a039-517e84918eb0 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:04.756729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd422-ef54-4fd0-a039-517e84918eb0 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:04.758311 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 471/938] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:04.765846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187d1b-1817-4daf-8dcc-e9e3ff1b6d66 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:04.765846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187d1b-1817-4daf-8dcc-e9e3ff1b6d66 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:04.765846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187d1b-1817-4daf-8dcc-e9e3ff1b6d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:04.807374 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-09187d1b-1817-4daf-8dcc-e9e3ff1b6d66 None None] MFA Rules not processed for user `21f5b87c9ea84f509bfa337f93338038`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:04.809058 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-09187d1b-1817-4daf-8dcc-e9e3ff1b6d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:04.852516 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:31:04.883317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 468/939] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:04 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:05.231888 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecd422-ef54-4fd0-a039-517e84918eb0 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:05.243172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecd422-ef54-4fd0-a039-517e84918eb0 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:05.249234 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475c19b-7140-4b19-9330-a908dc6feb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:05.249234 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c19b-7140-4b19-9330-a908dc6feb23 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:05.249234 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c19b-7140-4b19-9330-a908dc6feb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:05.249234 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c19b-7140-4b19-9330-a908dc6feb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:05.258399 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475c19b-7140-4b19-9330-a908dc6feb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:05.259945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475c19b-7140-4b19-9330-a908dc6feb23 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:05.287227 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 472/940] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:05 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:08.162095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378b2f-0340-4cfd-8c89-3f2369cca02e None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:08.162988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378b2f-0340-4cfd-8c89-3f2369cca02e None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:08.162988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378b2f-0340-4cfd-8c89-3f2369cca02e None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:08.165191 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 469/941] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:08.170676 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2026-b5c5-4961-99c0-07a85c326e7c None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:08.171130 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2026-b5c5-4961-99c0-07a85c326e7c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:08.171220 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2026-b5c5-4961-99c0-07a85c326e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:08.191613 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-89bd2026-b5c5-4961-99c0-07a85c326e7c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:08.192789 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-89bd2026-b5c5-4961-99c0-07a85c326e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:08.268809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 473/942] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:08 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:08.606450 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f378b2f-0340-4cfd-8c89-3f2369cca02e None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:08.619349 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f378b2f-0340-4cfd-8c89-3f2369cca02e None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:08.623895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42b7a5-d366-4cf8-a5e7-cdf6c39f0ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:08.624621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42b7a5-d366-4cf8-a5e7-cdf6c39f0ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:08.624996 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42b7a5-d366-4cf8-a5e7-cdf6c39f0ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:08.625264 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42b7a5-d366-4cf8-a5e7-cdf6c39f0ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:08.634225 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42b7a5-d366-4cf8-a5e7-cdf6c39f0ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:08.635692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42b7a5-d366-4cf8-a5e7-cdf6c39f0ec2 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:08.644814 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 470/943] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:08 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:11.530031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59d360-1620-4347-bd14-680fad65a0a0 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:11.530601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59d360-1620-4347-bd14-680fad65a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:11.530601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59d360-1620-4347-bd14-680fad65a0a0 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:11.531935 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 474/944] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:11.537365 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4380-012b-4b8a-a42e-c8d7315f4d9c None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:11.537799 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4380-012b-4b8a-a42e-c8d7315f4d9c None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:11.537874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4380-012b-4b8a-a42e-c8d7315f4d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:11.557873 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-f84d4380-012b-4b8a-a42e-c8d7315f4d9c None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:11.559100 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-f84d4380-012b-4b8a-a42e-c8d7315f4d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:11.567679 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 471/945] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:11.900927 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59d360-1620-4347-bd14-680fad65a0a0 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:11.912866 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59d360-1620-4347-bd14-680fad65a0a0 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:11.916941 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1f9f4-cb77-4980-898c-bb89b0468a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:11.917535 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f9f4-cb77-4980-898c-bb89b0468a1d service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:11.917804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f9f4-cb77-4980-898c-bb89b0468a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:11.918068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f9f4-cb77-4980-898c-bb89b0468a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:11.927287 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1f9f4-cb77-4980-898c-bb89b0468a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:11.928748 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1f9f4-cb77-4980-898c-bb89b0468a1d service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:11.938206 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 475/946] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:31:14.148203 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15918074-1c2a-4a09-808c-8c0fda9d27bf None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:14.148796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15918074-1c2a-4a09-808c-8c0fda9d27bf None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:14.148796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15918074-1c2a-4a09-808c-8c0fda9d27bf None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:14.150088 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 472/947] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:14.155457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345f30-6eb1-47bc-8928-b2d2f99d010e None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:14.155929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345f30-6eb1-47bc-8928-b2d2f99d010e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:14.155929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345f30-6eb1-47bc-8928-b2d2f99d010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:14.175937 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-f9345f30-6eb1-47bc-8928-b2d2f99d010e None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:14.177115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-f9345f30-6eb1-47bc-8928-b2d2f99d010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:14.186191 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 476/948] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:14.520190 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15918074-1c2a-4a09-808c-8c0fda9d27bf None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:14.532551 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15918074-1c2a-4a09-808c-8c0fda9d27bf None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:14.536716 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b148b-dcbb-435e-8199-45083c5199fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:14.537316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b148b-dcbb-435e-8199-45083c5199fe service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:14.537593 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b148b-dcbb-435e-8199-45083c5199fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:14.537863 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b148b-dcbb-435e-8199-45083c5199fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:14.547271 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b148b-dcbb-435e-8199-45083c5199fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:14.548712 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b148b-dcbb-435e-8199-45083c5199fe service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:14.558227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 473/949] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:16.785011 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0074-169a-4bd3-b231-6a023019eca2 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:16.785601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0074-169a-4bd3-b231-6a023019eca2 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:16.785601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0074-169a-4bd3-b231-6a023019eca2 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:16.786842 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 477/950] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:16.793195 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d11c5-2566-4e1d-b8e5-1a4a3f079347 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:16.793692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d11c5-2566-4e1d-b8e5-1a4a3f079347 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:16.794061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d11c5-2566-4e1d-b8e5-1a4a3f079347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:16.820346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b97d11c5-2566-4e1d-b8e5-1a4a3f079347 None None] MFA Rules not processed for user `21f5b87c9ea84f509bfa337f93338038`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:16.822650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b97d11c5-2566-4e1d-b8e5-1a4a3f079347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:16.833511 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 474/951] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:16 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:17.170622 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d0074-169a-4bd3-b231-6a023019eca2 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:17.183115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d0074-169a-4bd3-b231-6a023019eca2 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:17.187534 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac98f6-4e1b-4c2e-af08-cb62aaa10876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:17.188267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac98f6-4e1b-4c2e-af08-cb62aaa10876 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:17.188554 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac98f6-4e1b-4c2e-af08-cb62aaa10876 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:17.188792 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac98f6-4e1b-4c2e-af08-cb62aaa10876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:17.199306 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac98f6-4e1b-4c2e-af08-cb62aaa10876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:17.200822 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac98f6-4e1b-4c2e-af08-cb62aaa10876 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:17.211354 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 478/952] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:17 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:19.624154 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6e12-4f1f-4e0d-9c5b-918fda3eea16 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:19.624725 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6e12-4f1f-4e0d-9c5b-918fda3eea16 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:19.624725 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6e12-4f1f-4e0d-9c5b-918fda3eea16 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:19.626057 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 475/953] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:19.632048 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04f40-dc8a-48ee-b32a-cb0a94989f97 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:19.632601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04f40-dc8a-48ee-b32a-cb0a94989f97 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:19.632601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04f40-dc8a-48ee-b32a-cb0a94989f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:19.653136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-e5e04f40-dc8a-48ee-b32a-cb0a94989f97 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:19.654553 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-e5e04f40-dc8a-48ee-b32a-cb0a94989f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:19.663259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 479/954] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:19.995364 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6e12-4f1f-4e0d-9c5b-918fda3eea16 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:20.007136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6e12-4f1f-4e0d-9c5b-918fda3eea16 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:20.010897 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ed1b-bc75-48e9-80f5-002b2428f530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:20.011519 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ed1b-bc75-48e9-80f5-002b2428f530 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:20.011798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ed1b-bc75-48e9-80f5-002b2428f530 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:20.012062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ed1b-bc75-48e9-80f5-002b2428f530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:20.021506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ed1b-bc75-48e9-80f5-002b2428f530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:20.022978 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ed1b-bc75-48e9-80f5-002b2428f530 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:20.032659 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 476/955] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:22.247269 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a182003-4c6f-4809-97cc-997afe1a1fa2 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:22.248012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a182003-4c6f-4809-97cc-997afe1a1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:22.248012 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a182003-4c6f-4809-97cc-997afe1a1fa2 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:22.249104 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 480/956] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:22.254829 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a363-6d4c-4a40-9a37-6df9adbc0e30 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:22.255333 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a363-6d4c-4a40-9a37-6df9adbc0e30 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:22.255525 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a363-6d4c-4a40-9a37-6df9adbc0e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:22.275706 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-3ea0a363-6d4c-4a40-9a37-6df9adbc0e30 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:22.276915 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-3ea0a363-6d4c-4a40-9a37-6df9adbc0e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:22.285060 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 477/957] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:22.625071 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a182003-4c6f-4809-97cc-997afe1a1fa2 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:22.636862 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a182003-4c6f-4809-97cc-997afe1a1fa2 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:22.640489 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4f87d-b77d-49d2-a0a2-898b5c171689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:22.641088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f87d-b77d-49d2-a0a2-898b5c171689 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:22.641366 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f87d-b77d-49d2-a0a2-898b5c171689 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:22.641632 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f87d-b77d-49d2-a0a2-898b5c171689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:22.651558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4f87d-b77d-49d2-a0a2-898b5c171689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:22.653027 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4f87d-b77d-49d2-a0a2-898b5c171689 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:22.662747 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 481/958] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:25.301137 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2b4c-7395-4389-b82e-7303f7965cec None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:25.301733 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2b4c-7395-4389-b82e-7303f7965cec None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:25.301733 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2b4c-7395-4389-b82e-7303f7965cec None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:25.303018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 478/959] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:25.308532 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f612ca-4f6c-4d15-913d-5f27524c54e4 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:25.308971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f612ca-4f6c-4d15-913d-5f27524c54e4 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:25.309085 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f612ca-4f6c-4d15-913d-5f27524c54e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:25.339987 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-89f612ca-4f6c-4d15-913d-5f27524c54e4 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:25.341973 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-89f612ca-4f6c-4d15-913d-5f27524c54e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:25.351317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 482/960] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:25 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:25.700681 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2b4c-7395-4389-b82e-7303f7965cec None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:25.714342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2b4c-7395-4389-b82e-7303f7965cec None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:25.718797 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6bf6e-1aee-42de-98a1-b21df05afad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:25.719429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6bf6e-1aee-42de-98a1-b21df05afad3 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:25.719705 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6bf6e-1aee-42de-98a1-b21df05afad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:25.719973 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6bf6e-1aee-42de-98a1-b21df05afad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:25.729576 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6bf6e-1aee-42de-98a1-b21df05afad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:25.731034 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6bf6e-1aee-42de-98a1-b21df05afad3 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:25.740387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 479/961] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:25 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:29.996619 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4552b4-f179-41eb-98dc-5fbbf10ba0d5 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:29.997153 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4552b4-f179-41eb-98dc-5fbbf10ba0d5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:29.997153 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4552b4-f179-41eb-98dc-5fbbf10ba0d5 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:29.998683 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 483/962] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:30.004203 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a57f3-4663-4983-9b99-1084838cd944 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:30.004590 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a57f3-4663-4983-9b99-1084838cd944 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:30.004667 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a57f3-4663-4983-9b99-1084838cd944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:30.025453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-427a57f3-4663-4983-9b99-1084838cd944 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:30.026668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-427a57f3-4663-4983-9b99-1084838cd944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:30.036692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 480/963] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:30.375690 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4552b4-f179-41eb-98dc-5fbbf10ba0d5 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:30.381286 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=77 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:31:30.389173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4552b4-f179-41eb-98dc-5fbbf10ba0d5 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:30.393165 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e2948-e86b-46c7-99c5-1afdf45f14a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:30.393773 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e2948-e86b-46c7-99c5-1afdf45f14a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:30.394041 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e2948-e86b-46c7-99c5-1afdf45f14a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:30.394300 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e2948-e86b-46c7-99c5-1afdf45f14a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:30.404025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e2948-e86b-46c7-99c5-1afdf45f14a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:30.405486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e2948-e86b-46c7-99c5-1afdf45f14a8 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:30.415473 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 484/964] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:33.262388 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdeb5-2c6c-4247-8c93-5f5e51ccb720 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:33.263242 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdeb5-2c6c-4247-8c93-5f5e51ccb720 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:33.263242 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdeb5-2c6c-4247-8c93-5f5e51ccb720 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:33.264335 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 481/965] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:33.269877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127857-365a-4f17-b897-bf8a63a0f046 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:33.270313 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127857-365a-4f17-b897-bf8a63a0f046 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:33.270405 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127857-365a-4f17-b897-bf8a63a0f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:33.290318 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-ed127857-365a-4f17-b897-bf8a63a0f046 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:33.291523 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-ed127857-365a-4f17-b897-bf8a63a0f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:33.300364 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 485/966] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:33 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:33.646382 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cdeb5-2c6c-4247-8c93-5f5e51ccb720 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:33.659050 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cdeb5-2c6c-4247-8c93-5f5e51ccb720 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:33.663446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd701a-071c-4a22-a205-762a2c97ac2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:33.664067 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd701a-071c-4a22-a205-762a2c97ac2c service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:33.664341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd701a-071c-4a22-a205-762a2c97ac2c service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:33.664611 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd701a-071c-4a22-a205-762a2c97ac2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:33.674670 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd701a-071c-4a22-a205-762a2c97ac2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:33.676153 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd701a-071c-4a22-a205-762a2c97ac2c service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:33.685937 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 482/967] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:33 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:37.794172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c0379-2056-40dc-ad71-89a039d4a12c None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:37.794697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c0379-2056-40dc-ad71-89a039d4a12c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:37.794795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c0379-2056-40dc-ad71-89a039d4a12c None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:37.796321 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 486/968] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:37.802062 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332768-568f-413d-9f37-4ac077c7f5c4 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:37.802570 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332768-568f-413d-9f37-4ac077c7f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:37.802673 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332768-568f-413d-9f37-4ac077c7f5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:37.810923 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=54 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:31:37.824181 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-ee332768-568f-413d-9f37-4ac077c7f5c4 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:37.825472 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-ee332768-568f-413d-9f37-4ac077c7f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:37.834483 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 483/969] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:38.170866 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c0379-2056-40dc-ad71-89a039d4a12c None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:38.181884 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c0379-2056-40dc-ad71-89a039d4a12c None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:38.185511 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b855049-2c32-4917-95ec-9409ec26ea58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:38.186101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b855049-2c32-4917-95ec-9409ec26ea58 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:38.186372 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b855049-2c32-4917-95ec-9409ec26ea58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:38.186635 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b855049-2c32-4917-95ec-9409ec26ea58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:38.195746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b855049-2c32-4917-95ec-9409ec26ea58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:38.197190 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b855049-2c32-4917-95ec-9409ec26ea58 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:38.206536 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 487/970] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:43.685550 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3baea-14d8-44dc-bb9a-e44f3989e220 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:43.686033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3baea-14d8-44dc-bb9a-e44f3989e220 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:43.686033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3baea-14d8-44dc-bb9a-e44f3989e220 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:43.687969 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 484/971] 10.222.0.69 () {54 vars in 921 bytes} [Fri Aug 19 02:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:43.701588 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c77e6-7e8e-4241-b48f-7493b6066d9b None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:43.702030 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c77e6-7e8e-4241-b48f-7493b6066d9b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:43.702107 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c77e6-7e8e-4241-b48f-7493b6066d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:43.751173 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-c27c77e6-7e8e-4241-b48f-7493b6066d9b None None] MFA Rules not processed for user `530e9c679e6041f491eb9a93a74cc118`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:43.752385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-c27c77e6-7e8e-4241-b48f-7493b6066d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:43.857406 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 488/972] 10.222.0.69 () {58 vars in 1018 bytes} [Fri Aug 19 02:31:43 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:47.819237 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=2 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:31:48.279653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b2a7-dac0-426b-89ea-6d7c34130b65 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:48.280237 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b2a7-dac0-426b-89ea-6d7c34130b65 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:48.280663 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b2a7-dac0-426b-89ea-6d7c34130b65 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:48.282212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 485/973] 10.222.0.69 () {54 vars in 921 bytes} [Fri Aug 19 02:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:48.288112 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56444a85-c23d-474f-b1f1-a992f0616af1 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:48.289011 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56444a85-c23d-474f-b1f1-a992f0616af1 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:48.289462 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56444a85-c23d-474f-b1f1-a992f0616af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:48.310088 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-56444a85-c23d-474f-b1f1-a992f0616af1 None None] MFA Rules not processed for user `530e9c679e6041f491eb9a93a74cc118`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:48.311326 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-56444a85-c23d-474f-b1f1-a992f0616af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:48.321197 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 489/974] 10.222.0.69 () {58 vars in 1018 bytes} [Fri Aug 19 02:31:48 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:49.904686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bade67-da99-41c5-a765-824ac9c50b26 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:49.905229 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bade67-da99-41c5-a765-824ac9c50b26 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:49.905229 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bade67-da99-41c5-a765-824ac9c50b26 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:49.906478 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 486/975] 10.222.0.69 () {54 vars in 921 bytes} [Fri Aug 19 02:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:49.911935 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8f8d-0b12-4139-a923-1fd0135b7dd6 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:49.912395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8f8d-0b12-4139-a923-1fd0135b7dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:49.912487 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8f8d-0b12-4139-a923-1fd0135b7dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:49.933432 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-5a1e8f8d-0b12-4139-a923-1fd0135b7dd6 None None] MFA Rules not processed for user `530e9c679e6041f491eb9a93a74cc118`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:49.934606 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-5a1e8f8d-0b12-4139-a923-1fd0135b7dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:49.943576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 490/976] 10.222.0.69 () {58 vars in 1018 bytes} [Fri Aug 19 02:31:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:53.809401 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d735fa-9250-4bb0-98d1-906a130da82b None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:53.810636 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d735fa-9250-4bb0-98d1-906a130da82b None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:53.811218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d735fa-9250-4bb0-98d1-906a130da82b None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:53.812809 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 487/977] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:53.818486 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1ac3-c746-49c0-9b2b-f54f07f7f2ad None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:53.818911 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1ac3-c746-49c0-9b2b-f54f07f7f2ad None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:53.819061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1ac3-c746-49c0-9b2b-f54f07f7f2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:53.839050 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-1a5d1ac3-c746-49c0-9b2b-f54f07f7f2ad None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:53.840372 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-1a5d1ac3-c746-49c0-9b2b-f54f07f7f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:53.856145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 491/978] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:54.200154 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e088-e163-4b4d-9bd8-547cc7c51deb None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:54.201004 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e088-e163-4b4d-9bd8-547cc7c51deb None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:54.201610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e088-e163-4b4d-9bd8-547cc7c51deb None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:54.203524 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 488/979] 10.222.0.69 () {54 vars in 962 bytes} [Fri Aug 19 02:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:54.211918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722c088-960c-47c9-a187-ecb2c0cbb70c None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:54.212459 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722c088-960c-47c9-a187-ecb2c0cbb70c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:54.213090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722c088-960c-47c9-a187-ecb2c0cbb70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:54.252798 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-3722c088-960c-47c9-a187-ecb2c0cbb70c None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:54.253972 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-3722c088-960c-47c9-a187-ecb2c0cbb70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:54.324369 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:31:54.330254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 492/980] 10.222.0.69 () {58 vars in 1059 bytes} [Fri Aug 19 02:31:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:31:54.338654 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e088-e163-4b4d-9bd8-547cc7c51deb None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:54.352350 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e088-e163-4b4d-9bd8-547cc7c51deb None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:54.359820 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3bff2-c876-4932-8360-1eebd873009c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:54.360856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3bff2-c876-4932-8360-1eebd873009c service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:54.361338 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3bff2-c876-4932-8360-1eebd873009c service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:54.361816 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3bff2-c876-4932-8360-1eebd873009c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:54.372809 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3bff2-c876-4932-8360-1eebd873009c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:54.374740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3bff2-c876-4932-8360-1eebd873009c service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:54.386603 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 489/981] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:56.807570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a7e9e-90be-4f57-8f36-f49e79f3411e None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:56.808067 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a7e9e-90be-4f57-8f36-f49e79f3411e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:56.808163 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a7e9e-90be-4f57-8f36-f49e79f3411e None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:56.809625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 493/982] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:56.815095 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610ca4d-92f2-4772-bc21-18426f53a199 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:56.815548 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610ca4d-92f2-4772-bc21-18426f53a199 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:56.815679 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610ca4d-92f2-4772-bc21-18426f53a199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:56.835549 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b610ca4d-92f2-4772-bc21-18426f53a199 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:56.837121 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b610ca4d-92f2-4772-bc21-18426f53a199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:56.845101 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 490/983] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:57.185615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a7e9e-90be-4f57-8f36-f49e79f3411e None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:57.200937 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a7e9e-90be-4f57-8f36-f49e79f3411e None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:57.206286 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52c69-ab27-4122-96b9-cba45dccab14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:57.207025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52c69-ab27-4122-96b9-cba45dccab14 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:57.207428 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52c69-ab27-4122-96b9-cba45dccab14 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:57.207798 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52c69-ab27-4122-96b9-cba45dccab14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:57.217649 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52c69-ab27-4122-96b9-cba45dccab14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:57.219395 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52c69-ab27-4122-96b9-cba45dccab14 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:57.230195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 494/984] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:59.781554 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8048fd4-05ac-4701-be84-bf7733a15d31 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:59.782020 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8048fd4-05ac-4701-be84-bf7733a15d31 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:59.782136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8048fd4-05ac-4701-be84-bf7733a15d31 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:59.783520 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 491/985] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:31:59.788837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa260-0fd5-4937-8b62-4743fe94bc6b None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:59.789260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa260-0fd5-4937-8b62-4743fe94bc6b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:59.789379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa260-0fd5-4937-8b62-4743fe94bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:59.812653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-0daaa260-0fd5-4937-8b62-4743fe94bc6b None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:59.813875 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-0daaa260-0fd5-4937-8b62-4743fe94bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:59.828364 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 495/986] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:31:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:00.182624 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551cee-7ce9-4f53-b37d-c9dd87971751 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:00.183161 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551cee-7ce9-4f53-b37d-c9dd87971751 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:00.183497 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551cee-7ce9-4f53-b37d-c9dd87971751 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:00.185002 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 492/987] 10.222.0.69 () {54 vars in 962 bytes} [Fri Aug 19 02:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:00.190530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7c1ce-e103-4976-848b-f6a485583b87 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:00.190882 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7c1ce-e103-4976-848b-f6a485583b87 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:00.191275 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7c1ce-e103-4976-848b-f6a485583b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:00.214064 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-2ad7c1ce-e103-4976-848b-f6a485583b87 None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:00.215435 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-2ad7c1ce-e103-4976-848b-f6a485583b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:00.224460 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 496/988] 10.222.0.69 () {58 vars in 1059 bytes} [Fri Aug 19 02:32:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:00.233252 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09551cee-7ce9-4f53-b37d-c9dd87971751 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:00.249332 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09551cee-7ce9-4f53-b37d-c9dd87971751 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:00.256515 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a450e-5550-407b-9550-662c50295d0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:00.257363 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a450e-5550-407b-9550-662c50295d0d service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:00.257781 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a450e-5550-407b-9550-662c50295d0d service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:00.258052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a450e-5550-407b-9550-662c50295d0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:00.267369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a450e-5550-407b-9550-662c50295d0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:00.269193 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a450e-5550-407b-9550-662c50295d0d service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:00.280351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 493/989] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:02.717605 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103294cc-494f-406a-88f3-8d1f7acaebd2 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:02.718713 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103294cc-494f-406a-88f3-8d1f7acaebd2 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:02.719240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103294cc-494f-406a-88f3-8d1f7acaebd2 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:02.724799 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 497/990] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:02.726165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daab3c-d866-4bfc-a753-5468ad372718 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:02.726583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daab3c-d866-4bfc-a753-5468ad372718 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:02.726686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daab3c-d866-4bfc-a753-5468ad372718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:02.746710 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-39daab3c-d866-4bfc-a753-5468ad372718 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:02.748267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-39daab3c-d866-4bfc-a753-5468ad372718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:02.757220 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 494/991] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:32:03.128805 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103294cc-494f-406a-88f3-8d1f7acaebd2 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:03.142918 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103294cc-494f-406a-88f3-8d1f7acaebd2 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:03.148283 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c457d-ab43-4080-935a-af00d1c03d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:03.149124 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c457d-ab43-4080-935a-af00d1c03d6c service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:03.149601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c457d-ab43-4080-935a-af00d1c03d6c service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:03.150077 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c457d-ab43-4080-935a-af00d1c03d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:03.159889 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c457d-ab43-4080-935a-af00d1c03d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:03.161791 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c457d-ab43-4080-935a-af00d1c03d6c service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:03.183392 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 498/992] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:04.032847 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6125050-e3aa-488c-9783-6d41e7444fea None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:04.033640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6125050-e3aa-488c-9783-6d41e7444fea None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:04.034052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6125050-e3aa-488c-9783-6d41e7444fea None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:04.035867 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 495/993] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:04.041877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01acb-eb00-439a-8fd9-32bee8aa6492 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:04.042282 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01acb-eb00-439a-8fd9-32bee8aa6492 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:04.042382 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01acb-eb00-439a-8fd9-32bee8aa6492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:04.063469 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-bed01acb-eb00-439a-8fd9-32bee8aa6492 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:04.064644 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-bed01acb-eb00-439a-8fd9-32bee8aa6492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:04.083509 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 499/994] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:04.704089 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafaa6e-1449-4883-ac82-c4880c198858 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:04.705119 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafaa6e-1449-4883-ac82-c4880c198858 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:04.705119 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafaa6e-1449-4883-ac82-c4880c198858 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:04.706530 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 496/995] 10.222.0.69 () {54 vars in 964 bytes} [Fri Aug 19 02:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:04.711986 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dc788-8a68-4816-a71d-d25317d928a7 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:04.712387 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dc788-8a68-4816-a71d-d25317d928a7 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:04.712840 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dc788-8a68-4816-a71d-d25317d928a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:04.751923 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-968dc788-8a68-4816-a71d-d25317d928a7 None None] MFA Rules not processed for user `5c679a1bdee541f2830dce7ee89e60f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:04.753300 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-968dc788-8a68-4816-a71d-d25317d928a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:04.827463 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 500/996] 10.222.0.69 () {58 vars in 1061 bytes} [Fri Aug 19 02:32:04 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:04.834970 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafaa6e-1449-4883-ac82-c4880c198858 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:04.846647 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafaa6e-1449-4883-ac82-c4880c198858 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:04.850339 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f992b6e-ed19-4a5a-ae91-dc750cc09a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c679a1bdee541f2830dce7ee89e60f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:04.851084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992b6e-ed19-4a5a-ae91-dc750cc09a84 service cinder] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:04.851453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992b6e-ed19-4a5a-ae91-dc750cc09a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:04.851983 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992b6e-ed19-4a5a-ae91-dc750cc09a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:04.861759 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f992b6e-ed19-4a5a-ae91-dc750cc09a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:04.863414 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f992b6e-ed19-4a5a-ae91-dc750cc09a84 service cinder] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:04.873275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 497/997] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:05.532868 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b4e5-4d12-49a8-914d-6e1b910ec84b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:05.534428 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b4e5-4d12-49a8-914d-6e1b910ec84b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:05.534844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b4e5-4d12-49a8-914d-6e1b910ec84b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:05.536966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 501/998] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:05.541956 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afdca6-71d3-4059-9af9-bd70d68c0c00 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:05.542476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afdca6-71d3-4059-9af9-bd70d68c0c00 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:05.542476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afdca6-71d3-4059-9af9-bd70d68c0c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:05.566426 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-d1afdca6-71d3-4059-9af9-bd70d68c0c00 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:05.567953 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-d1afdca6-71d3-4059-9af9-bd70d68c0c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:05.595425 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 498/999] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:05.926164 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b4e5-4d12-49a8-914d-6e1b910ec84b None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:05.947118 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b4e5-4d12-49a8-914d-6e1b910ec84b None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:05.953078 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcbdf0-ca2c-464d-849b-793d958a4ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:05.953943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbdf0-ca2c-464d-849b-793d958a4ada service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:05.954303 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbdf0-ca2c-464d-849b-793d958a4ada service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:05.954731 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbdf0-ca2c-464d-849b-793d958a4ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:05.966584 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcbdf0-ca2c-464d-849b-793d958a4ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:05.968467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcbdf0-ca2c-464d-849b-793d958a4ada service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:05.981834 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 502/1000] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:08.239130 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7643a-c116-450d-a731-156c1a7875d6 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:08.239720 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7643a-c116-450d-a731-156c1a7875d6 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:08.239720 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7643a-c116-450d-a731-156c1a7875d6 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:08.241017 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 499/1001] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:08.246388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d094-8bca-4009-9461-eeff5b338839 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:08.246827 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d094-8bca-4009-9461-eeff5b338839 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:08.246972 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d094-8bca-4009-9461-eeff5b338839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:08.266954 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-2f68d094-8bca-4009-9461-eeff5b338839 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:08.268184 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-2f68d094-8bca-4009-9461-eeff5b338839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:08.276579 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 503/1002] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:08.618722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7643a-c116-450d-a731-156c1a7875d6 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:08.639964 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7643a-c116-450d-a731-156c1a7875d6 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:08.645918 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9919206-5346-493d-8ad6-b7a2d030a91d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:08.646533 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9919206-5346-493d-8ad6-b7a2d030a91d service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:08.646811 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9919206-5346-493d-8ad6-b7a2d030a91d service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:08.647109 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9919206-5346-493d-8ad6-b7a2d030a91d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:08.655642 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9919206-5346-493d-8ad6-b7a2d030a91d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:08.657290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9919206-5346-493d-8ad6-b7a2d030a91d service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:08.666886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 500/1003] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:10.930985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379befd-9edb-4ad8-8dbf-a50563b39ec4 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:10.932024 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379befd-9edb-4ad8-8dbf-a50563b39ec4 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:10.932600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379befd-9edb-4ad8-8dbf-a50563b39ec4 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:10.934184 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 504/1004] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:10.940081 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa562-e687-4f4e-9525-6a878f2f61f9 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:10.940546 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa562-e687-4f4e-9525-6a878f2f61f9 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:10.940789 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa562-e687-4f4e-9525-6a878f2f61f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:10.961699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-4b8aa562-e687-4f4e-9525-6a878f2f61f9 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:10.963746 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-4b8aa562-e687-4f4e-9525-6a878f2f61f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:10.975380 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 501/1005] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:11.316840 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379befd-9edb-4ad8-8dbf-a50563b39ec4 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:11.331426 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379befd-9edb-4ad8-8dbf-a50563b39ec4 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:11.337408 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb08bfd-2952-4a0c-86c5-214a3a132211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:11.338179 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08bfd-2952-4a0c-86c5-214a3a132211 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:11.338622 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08bfd-2952-4a0c-86c5-214a3a132211 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:11.339090 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08bfd-2952-4a0c-86c5-214a3a132211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:11.348260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb08bfd-2952-4a0c-86c5-214a3a132211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:11.350223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb08bfd-2952-4a0c-86c5-214a3a132211 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:11.374556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 505/1006] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:13.656958 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ed38-2042-43e8-bc19-e426fbb391eb None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:13.657442 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ed38-2042-43e8-bc19-e426fbb391eb None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:13.657565 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ed38-2042-43e8-bc19-e426fbb391eb None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:13.658899 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 502/1007] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:13.665353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863bf6b-c150-432f-baa0-8d2167c9c713 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:13.665802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863bf6b-c150-432f-baa0-8d2167c9c713 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:13.665885 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863bf6b-c150-432f-baa0-8d2167c9c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:13.687984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-4863bf6b-c150-432f-baa0-8d2167c9c713 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:13.689340 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-4863bf6b-c150-432f-baa0-8d2167c9c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:13.703049 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 506/1008] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:14.043162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512ed38-2042-43e8-bc19-e426fbb391eb None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:14.062551 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512ed38-2042-43e8-bc19-e426fbb391eb None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:14.067782 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4207d7-c9ef-48fb-a5fd-4fd7f88f0c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:14.068423 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4207d7-c9ef-48fb-a5fd-4fd7f88f0c17 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:14.068696 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4207d7-c9ef-48fb-a5fd-4fd7f88f0c17 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:14.068963 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4207d7-c9ef-48fb-a5fd-4fd7f88f0c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:14.079039 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4207d7-c9ef-48fb-a5fd-4fd7f88f0c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:14.080878 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4207d7-c9ef-48fb-a5fd-4fd7f88f0c17 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:14.091738 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 503/1009] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:16.746266 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeccd-3052-4df2-9837-20967e946a21 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:16.746960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeccd-3052-4df2-9837-20967e946a21 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:16.746960 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeccd-3052-4df2-9837-20967e946a21 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:16.748298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 507/1010] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:16.756019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986762dc-557d-4019-a3d8-57bcccfa5743 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:16.756563 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986762dc-557d-4019-a3d8-57bcccfa5743 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:16.756563 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986762dc-557d-4019-a3d8-57bcccfa5743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:16.781705 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-986762dc-557d-4019-a3d8-57bcccfa5743 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:16.782964 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-986762dc-557d-4019-a3d8-57bcccfa5743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:16.795047 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 504/1011] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:17.237647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beeccd-3052-4df2-9837-20967e946a21 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:17.255603 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beeccd-3052-4df2-9837-20967e946a21 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:17.264555 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a301aa-77d6-47b8-b698-073b3df0413d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:17.265226 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a301aa-77d6-47b8-b698-073b3df0413d service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:17.265539 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a301aa-77d6-47b8-b698-073b3df0413d service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:17.265810 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a301aa-77d6-47b8-b698-073b3df0413d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:17.278767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a301aa-77d6-47b8-b698-073b3df0413d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:17.280736 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a301aa-77d6-47b8-b698-073b3df0413d service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:17.294889 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 508/1012] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:20.272172 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcd097-4994-4c15-8f4e-c705d675a018 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:20.272820 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcd097-4994-4c15-8f4e-c705d675a018 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:20.272820 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcd097-4994-4c15-8f4e-c705d675a018 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:20.274069 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 505/1013] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:20.279880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86fdb-17da-4f1a-96e4-35ee494a8fe8 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:20.280353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86fdb-17da-4f1a-96e4-35ee494a8fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:20.280440 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86fdb-17da-4f1a-96e4-35ee494a8fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:20.299612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-21d86fdb-17da-4f1a-96e4-35ee494a8fe8 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:20.300801 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-21d86fdb-17da-4f1a-96e4-35ee494a8fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:20.310489 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 509/1014] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:20.659164 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcd097-4994-4c15-8f4e-c705d675a018 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:20.667827 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=46 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:32:20.675168 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcd097-4994-4c15-8f4e-c705d675a018 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:20.680317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eaea7-b255-4b19-9ba1-d6cb51b8dc01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:20.680914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eaea7-b255-4b19-9ba1-d6cb51b8dc01 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:20.681376 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eaea7-b255-4b19-9ba1-d6cb51b8dc01 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:20.681493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eaea7-b255-4b19-9ba1-d6cb51b8dc01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:20.690649 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82eaea7-b255-4b19-9ba1-d6cb51b8dc01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:20.692267 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82eaea7-b255-4b19-9ba1-d6cb51b8dc01 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:20.702351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 506/1015] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:21.494802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eef04-c957-46f6-85b0-3672f83badb3 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:21.495461 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eef04-c957-46f6-85b0-3672f83badb3 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:21.495461 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eef04-c957-46f6-85b0-3672f83badb3 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:21.496807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 510/1016] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:21.502293 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74764-63c7-4c81-a27a-532bde58b71f None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:21.502791 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74764-63c7-4c81-a27a-532bde58b71f None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:21.502888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74764-63c7-4c81-a27a-532bde58b71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:21.522087 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-54c74764-63c7-4c81-a27a-532bde58b71f None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:21.523328 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-54c74764-63c7-4c81-a27a-532bde58b71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:21.532196 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 507/1017] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:21.893256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9187-5e53-4801-ac40-8359f8944dd6 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:21.893491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9187-5e53-4801-ac40-8359f8944dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:21.893782 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9187-5e53-4801-ac40-8359f8944dd6 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:21.895188 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 511/1018] 10.222.0.69 () {54 vars in 967 bytes} [Fri Aug 19 02:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:21.900537 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2e30-d312-4786-99f9-b567485fc74d None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:21.900912 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2e30-d312-4786-99f9-b567485fc74d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:21.901276 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a2e30-d312-4786-99f9-b567485fc74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:21.941842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-da0a2e30-d312-4786-99f9-b567485fc74d None None] MFA Rules not processed for user `3eb9db2887ee4e81aee4a4e2228f0add`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:21.943090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-da0a2e30-d312-4786-99f9-b567485fc74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:22.007699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 508/1019] 10.222.0.69 () {58 vars in 1064 bytes} [Fri Aug 19 02:32:21 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:22.015601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9187-5e53-4801-ac40-8359f8944dd6 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:22.027021 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9187-5e53-4801-ac40-8359f8944dd6 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:22.030690 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41407ba-f559-4dd2-bb08-ce725636dc77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eb9db2887ee4e81aee4a4e2228f0add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:22.031309 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41407ba-f559-4dd2-bb08-ce725636dc77 service glance] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:22.031579 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41407ba-f559-4dd2-bb08-ce725636dc77 service glance] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:22.031849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41407ba-f559-4dd2-bb08-ce725636dc77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:22.040557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41407ba-f559-4dd2-bb08-ce725636dc77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:22.041984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41407ba-f559-4dd2-bb08-ce725636dc77 service glance] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:22.051200 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 512/1020] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:22.916305 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56dfa-8a61-4c30-aaa7-98a74a0de320 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:22.916946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56dfa-8a61-4c30-aaa7-98a74a0de320 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:22.916946 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56dfa-8a61-4c30-aaa7-98a74a0de320 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:22.918387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 509/1021] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:22.924010 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71517e6-51b9-4b23-ad4a-0a9af12977a4 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:22.924568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71517e6-51b9-4b23-ad4a-0a9af12977a4 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:22.924676 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71517e6-51b9-4b23-ad4a-0a9af12977a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:22.946580 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-f71517e6-51b9-4b23-ad4a-0a9af12977a4 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:22.947848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-f71517e6-51b9-4b23-ad4a-0a9af12977a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:22.957616 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 513/1022] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:23.299865 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c56dfa-8a61-4c30-aaa7-98a74a0de320 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:23.315240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c56dfa-8a61-4c30-aaa7-98a74a0de320 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:23.320416 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33e564-9018-488f-8898-3d217e296187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:23.321028 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e564-9018-488f-8898-3d217e296187 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:23.321309 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e564-9018-488f-8898-3d217e296187 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:23.321582 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e564-9018-488f-8898-3d217e296187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:23.342564 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33e564-9018-488f-8898-3d217e296187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:23.344890 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33e564-9018-488f-8898-3d217e296187 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:23.356960 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 510/1023] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:25.597277 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dacfc-b36d-4b4f-98f4-7383f4844ebe None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:25.597931 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dacfc-b36d-4b4f-98f4-7383f4844ebe None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:25.597931 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dacfc-b36d-4b4f-98f4-7383f4844ebe None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:25.599198 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 514/1024] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:25.604802 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe047-4158-44f4-b42a-21865fd4d018 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:25.605286 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe047-4158-44f4-b42a-21865fd4d018 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:25.605374 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe047-4158-44f4-b42a-21865fd4d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:25.628183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-77dfe047-4158-44f4-b42a-21865fd4d018 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:25.629411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-77dfe047-4158-44f4-b42a-21865fd4d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:25.640976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 511/1025] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:32:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:25.987618 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dacfc-b36d-4b4f-98f4-7383f4844ebe None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:25.995733 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=92 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:32:26.002787 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dacfc-b36d-4b4f-98f4-7383f4844ebe None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:26.007796 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b3b34-c12c-4ed2-9485-27b1df8dd006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:26.011034 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b3b34-c12c-4ed2-9485-27b1df8dd006 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:26.011034 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b3b34-c12c-4ed2-9485-27b1df8dd006 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:26.011034 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b3b34-c12c-4ed2-9485-27b1df8dd006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:26.018219 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b3b34-c12c-4ed2-9485-27b1df8dd006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:26.019842 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b3b34-c12c-4ed2-9485-27b1df8dd006 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:26.029476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 515/1026] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:35.621212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=50 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:32:36.025138 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=5 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:32:37.299407 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53d02d-5691-44d6-b164-515484210d38 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:37.300046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53d02d-5691-44d6-b164-515484210d38 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:37.300046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53d02d-5691-44d6-b164-515484210d38 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:37.301298 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 512/1027] 10.222.0.69 () {54 vars in 918 bytes} [Fri Aug 19 02:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:37.306576 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458ce9-e704-4df0-812f-b97efd8373f7 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:37.307069 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458ce9-e704-4df0-812f-b97efd8373f7 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:37.307178 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458ce9-e704-4df0-812f-b97efd8373f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:37.328064 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-a7458ce9-e704-4df0-812f-b97efd8373f7 None None] MFA Rules not processed for user `530e9c679e6041f491eb9a93a74cc118`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:37.329289 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-a7458ce9-e704-4df0-812f-b97efd8373f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:37.339665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 516/1028] 10.222.0.69 () {58 vars in 1015 bytes} [Fri Aug 19 02:32:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:37.354146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87027347-3cba-4122-9883-d2e7d053ba72 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:37.354428 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87027347-3cba-4122-9883-d2e7d053ba72 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:37.354689 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87027347-3cba-4122-9883-d2e7d053ba72 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:37.356084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 513/1029] 10.222.0.69 () {54 vars in 918 bytes} [Fri Aug 19 02:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:37.361172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873a80-be31-4cd9-ab29-bbdf5f2d7460 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:37.361507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873a80-be31-4cd9-ab29-bbdf5f2d7460 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:37.361787 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873a80-be31-4cd9-ab29-bbdf5f2d7460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:37.382136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-57873a80-be31-4cd9-ab29-bbdf5f2d7460 None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:37.383362 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-57873a80-be31-4cd9-ab29-bbdf5f2d7460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:37.392892 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 517/1030] 10.222.0.69 () {58 vars in 1015 bytes} [Fri Aug 19 02:32:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:40.112822 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b6b8-857b-4f15-b76b-623d965529d1 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:40.113770 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b6b8-857b-4f15-b76b-623d965529d1 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:40.113770 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b6b8-857b-4f15-b76b-623d965529d1 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:40.115889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:40.121356 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c560d0-ccf5-4598-abbc-a8c1639b0367 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:40.121833 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c560d0-ccf5-4598-abbc-a8c1639b0367 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:40.121938 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c560d0-ccf5-4598-abbc-a8c1639b0367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:40.142652 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-b2c560d0-ccf5-4598-abbc-a8c1639b0367 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:40.144148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-b2c560d0-ccf5-4598-abbc-a8c1639b0367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:40.153957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:32:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:40.498969 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b6b8-857b-4f15-b76b-623d965529d1 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:40.513888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b6b8-857b-4f15-b76b-623d965529d1 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:40.519468 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f67ffd-61a9-4b6f-95df-1fcb02aa2e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:40.520063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67ffd-61a9-4b6f-95df-1fcb02aa2e6c service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:40.520334 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67ffd-61a9-4b6f-95df-1fcb02aa2e6c service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:40.520600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67ffd-61a9-4b6f-95df-1fcb02aa2e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:40.529302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f67ffd-61a9-4b6f-95df-1fcb02aa2e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:40.530852 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f67ffd-61a9-4b6f-95df-1fcb02aa2e6c service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:40.540759 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 515/1033] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:41.480309 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2451-140f-49ea-96bb-a75c75d5de13 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:41.480917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2451-140f-49ea-96bb-a75c75d5de13 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:41.480917 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2451-140f-49ea-96bb-a75c75d5de13 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:41.482203 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:41.488341 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b0bdb-4f7c-42a4-ad51-b8f583ac4d85 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:41.489091 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b0bdb-4f7c-42a4-ad51-b8f583ac4d85 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:41.489241 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b0bdb-4f7c-42a4-ad51-b8f583ac4d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:41.520106 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-da8b0bdb-4f7c-42a4-ad51-b8f583ac4d85 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:41.521322 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-da8b0bdb-4f7c-42a4-ad51-b8f583ac4d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:41.530866 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:32:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:41.734769 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee2451-140f-49ea-96bb-a75c75d5de13 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:41.755582 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee2451-140f-49ea-96bb-a75c75d5de13 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:41.761383 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518733e-fa7d-4235-a354-1908183b48a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:41.761992 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518733e-fa7d-4235-a354-1908183b48a4 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:41.762261 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518733e-fa7d-4235-a354-1908183b48a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:41.762522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518733e-fa7d-4235-a354-1908183b48a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:41.771358 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518733e-fa7d-4235-a354-1908183b48a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:41.773753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518733e-fa7d-4235-a354-1908183b48a4 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:41.785239 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 520/1036] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:42.707335 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c0fd-7010-4fa1-b61f-a4af9e1a6e48 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:42.708275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c0fd-7010-4fa1-b61f-a4af9e1a6e48 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:42.708639 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c0fd-7010-4fa1-b61f-a4af9e1a6e48 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:42.711285 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:32:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:42.717247 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3c0bd-899b-4782-a28b-3b50a9aae330 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:42.717734 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3c0bd-899b-4782-a28b-3b50a9aae330 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:42.717734 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3c0bd-899b-4782-a28b-3b50a9aae330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:42.737602 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-fbb3c0bd-899b-4782-a28b-3b50a9aae330 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:42.738796 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-fbb3c0bd-899b-4782-a28b-3b50a9aae330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:42.746885 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:32:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:42.900889 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39c0fd-7010-4fa1-b61f-a4af9e1a6e48 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:42.922029 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39c0fd-7010-4fa1-b61f-a4af9e1a6e48 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:42.928361 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de70ab-1cde-49bb-8b9c-34f57d97d678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:42.928963 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de70ab-1cde-49bb-8b9c-34f57d97d678 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:42.929227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de70ab-1cde-49bb-8b9c-34f57d97d678 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:42.929507 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de70ab-1cde-49bb-8b9c-34f57d97d678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:42.937976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de70ab-1cde-49bb-8b9c-34f57d97d678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:42.939598 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de70ab-1cde-49bb-8b9c-34f57d97d678 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:42.948891 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 518/1039] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:43.821515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215b3d-9d55-49e9-8b8e-24f442744015 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:43.822121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215b3d-9d55-49e9-8b8e-24f442744015 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:43.822121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215b3d-9d55-49e9-8b8e-24f442744015 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:43.823420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:43.829490 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546478-451b-465c-a47a-8c665c739d78 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:43.830258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546478-451b-465c-a47a-8c665c739d78 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:43.830373 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546478-451b-465c-a47a-8c665c739d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:43.859933 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-5c546478-451b-465c-a47a-8c665c739d78 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:43.861162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-5c546478-451b-465c-a47a-8c665c739d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:43.870587 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:32:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:44.025449 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215b3d-9d55-49e9-8b8e-24f442744015 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:44.041938 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215b3d-9d55-49e9-8b8e-24f442744015 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:44.047987 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68affcc-e7c0-4bdf-93e7-b4518b33c231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:44.048991 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68affcc-e7c0-4bdf-93e7-b4518b33c231 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:44.049473 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68affcc-e7c0-4bdf-93e7-b4518b33c231 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:44.049990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68affcc-e7c0-4bdf-93e7-b4518b33c231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:44.062426 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68affcc-e7c0-4bdf-93e7-b4518b33c231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:44.064042 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68affcc-e7c0-4bdf-93e7-b4518b33c231 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:44.073653 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 523/1042] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:44.968445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237551d-0d5c-4bf4-bbd6-33b96adcace9 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:44.969370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237551d-0d5c-4bf4-bbd6-33b96adcace9 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:44.969370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237551d-0d5c-4bf4-bbd6-33b96adcace9 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:44.971484 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:44.977557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050030b-2440-4921-a0be-202d97046b65 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:44.978296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050030b-2440-4921-a0be-202d97046b65 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:44.978475 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050030b-2440-4921-a0be-202d97046b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:45.006570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-1050030b-2440-4921-a0be-202d97046b65 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:45.007806 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-1050030b-2440-4921-a0be-202d97046b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:45.017645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:32:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:45.175077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237551d-0d5c-4bf4-bbd6-33b96adcace9 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:45.190143 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237551d-0d5c-4bf4-bbd6-33b96adcace9 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:45.195952 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00dfcd-8508-45b9-bf08-f69b3e7e3fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:45.196536 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dfcd-8508-45b9-bf08-f69b3e7e3fe1 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:45.196805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dfcd-8508-45b9-bf08-f69b3e7e3fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:45.197066 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dfcd-8508-45b9-bf08-f69b3e7e3fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:45.205436 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00dfcd-8508-45b9-bf08-f69b3e7e3fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:45.207047 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00dfcd-8508-45b9-bf08-f69b3e7e3fe1 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:45.216872 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 521/1045] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:46.024731 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ca43-d607-491c-91f0-70a3f416258b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:46.025314 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ca43-d607-491c-91f0-70a3f416258b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:46.025314 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5ca43-d607-491c-91f0-70a3f416258b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:46.026505 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:46.032802 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012f42-aa65-4728-968c-8e4cc794bd63 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:46.033638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012f42-aa65-4728-968c-8e4cc794bd63 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:46.033638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de012f42-aa65-4728-968c-8e4cc794bd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:46.058458 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-de012f42-aa65-4728-968c-8e4cc794bd63 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:46.059698 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-de012f42-aa65-4728-968c-8e4cc794bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:46.069134 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:32:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:46.227544 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5ca43-d607-491c-91f0-70a3f416258b None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:46.243364 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5ca43-d607-491c-91f0-70a3f416258b None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:46.249056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aecaf-b79c-49b4-90fe-a80345cced4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:46.249645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aecaf-b79c-49b4-90fe-a80345cced4b service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:46.249912 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aecaf-b79c-49b4-90fe-a80345cced4b service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:46.250177 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aecaf-b79c-49b4-90fe-a80345cced4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:46.258330 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aecaf-b79c-49b4-90fe-a80345cced4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:46.259939 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aecaf-b79c-49b4-90fe-a80345cced4b service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:46.269398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 526/1048] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:47.090654 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c190a99-c8ab-4331-882f-9b6973f8fa66 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:47.091570 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c190a99-c8ab-4331-882f-9b6973f8fa66 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:47.091570 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c190a99-c8ab-4331-882f-9b6973f8fa66 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:47.092921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:47.100819 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded7ad-04a5-4e69-bedf-2f5713cba6f3 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:47.101555 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded7ad-04a5-4e69-bedf-2f5713cba6f3 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:47.101811 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded7ad-04a5-4e69-bedf-2f5713cba6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:47.129726 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-6dded7ad-04a5-4e69-bedf-2f5713cba6f3 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:47.130946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-6dded7ad-04a5-4e69-bedf-2f5713cba6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:47.139778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:32:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:47.298960 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c190a99-c8ab-4331-882f-9b6973f8fa66 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:47.318446 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c190a99-c8ab-4331-882f-9b6973f8fa66 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:47.325127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f362abe-6df9-49f8-aed0-6bc153e19b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:47.325728 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362abe-6df9-49f8-aed0-6bc153e19b2a service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:47.326049 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362abe-6df9-49f8-aed0-6bc153e19b2a service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:47.326316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362abe-6df9-49f8-aed0-6bc153e19b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:47.334805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f362abe-6df9-49f8-aed0-6bc153e19b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:47.336774 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f362abe-6df9-49f8-aed0-6bc153e19b2a service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:47.346492 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 524/1051] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:48.164945 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be3d4-0c95-4f66-8654-9e27fa5fb5c5 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:48.165835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be3d4-0c95-4f66-8654-9e27fa5fb5c5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:48.165835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be3d4-0c95-4f66-8654-9e27fa5fb5c5 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:48.168002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:32:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:48.173227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da69ad3-5120-4051-a39b-95fccc078b84 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:48.173689 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da69ad3-5120-4051-a39b-95fccc078b84 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:48.173801 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da69ad3-5120-4051-a39b-95fccc078b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:48.194876 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-0da69ad3-5120-4051-a39b-95fccc078b84 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:48.196126 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-0da69ad3-5120-4051-a39b-95fccc078b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:48.204981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:32:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:48.360882 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847be3d4-0c95-4f66-8654-9e27fa5fb5c5 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:48.377140 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847be3d4-0c95-4f66-8654-9e27fa5fb5c5 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:48.383353 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55120f-4c35-4f16-a8a7-763f96a11d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:48.383946 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55120f-4c35-4f16-a8a7-763f96a11d04 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:48.384186 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55120f-4c35-4f16-a8a7-763f96a11d04 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:48.384478 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55120f-4c35-4f16-a8a7-763f96a11d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:48.393261 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55120f-4c35-4f16-a8a7-763f96a11d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:48.394859 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55120f-4c35-4f16-a8a7-763f96a11d04 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:48.404351 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 529/1054] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:49.263408 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3775d-6754-49dd-bb2a-b0813fd4990d None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:49.264087 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3775d-6754-49dd-bb2a-b0813fd4990d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:49.264087 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3775d-6754-49dd-bb2a-b0813fd4990d None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:49.265300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:49.271257 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9fb44-2b1d-45a2-8588-1a8bba74eb00 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:49.271704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9fb44-2b1d-45a2-8588-1a8bba74eb00 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:49.271795 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9fb44-2b1d-45a2-8588-1a8bba74eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:49.296089 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-29d9fb44-2b1d-45a2-8588-1a8bba74eb00 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:49.297842 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-29d9fb44-2b1d-45a2-8588-1a8bba74eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:49.309183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:32:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:49.465096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3775d-6754-49dd-bb2a-b0813fd4990d None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:49.480999 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3775d-6754-49dd-bb2a-b0813fd4990d None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:49.487218 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4699d63-f801-4936-a6a8-a1ac11dc92f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:49.487805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699d63-f801-4936-a6a8-a1ac11dc92f6 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:49.488077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699d63-f801-4936-a6a8-a1ac11dc92f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:49.488339 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699d63-f801-4936-a6a8-a1ac11dc92f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:49.497337 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4699d63-f801-4936-a6a8-a1ac11dc92f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:49.499027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4699d63-f801-4936-a6a8-a1ac11dc92f6 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:49.508432 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 527/1057] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:51.564558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023eceb-4aa0-411e-afda-b9ab7dd8f8c1 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:51.565192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023eceb-4aa0-411e-afda-b9ab7dd8f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:51.565192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023eceb-4aa0-411e-afda-b9ab7dd8f8c1 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:51.566456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:32:51.573076 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513b316-4e08-41ee-ab3b-cacf1165d107 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:51.573804 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513b316-4e08-41ee-ab3b-cacf1165d107 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:51.573948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513b316-4e08-41ee-ab3b-cacf1165d107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:51.601016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-e513b316-4e08-41ee-ab3b-cacf1165d107 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:51.602238 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-e513b316-4e08-41ee-ab3b-cacf1165d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:51.610919 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:32:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:51.954901 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023eceb-4aa0-411e-afda-b9ab7dd8f8c1 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:51.966554 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023eceb-4aa0-411e-afda-b9ab7dd8f8c1 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:51.970145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1204935-f42d-4b0b-bea5-6326a2f532e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:51.970739 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1204935-f42d-4b0b-bea5-6326a2f532e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:51.971047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1204935-f42d-4b0b-bea5-6326a2f532e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:51.971316 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1204935-f42d-4b0b-bea5-6326a2f532e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:51.980397 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1204935-f42d-4b0b-bea5-6326a2f532e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:51.981840 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1204935-f42d-4b0b-bea5-6326a2f532e3 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:51.991391 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 532/1060] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:54.389292 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24534-2fb2-4d0a-96a1-b31d8b56810e None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:54.389866 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24534-2fb2-4d0a-96a1-b31d8b56810e None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:54.389866 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24534-2fb2-4d0a-96a1-b31d8b56810e None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:54.391188 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:32:54.397482 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcefb8-ca90-48d8-a409-bb49a9538aca None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:54.397950 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcefb8-ca90-48d8-a409-bb49a9538aca None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:54.398051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcefb8-ca90-48d8-a409-bb49a9538aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:54.426377 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-77dcefb8-ca90-48d8-a409-bb49a9538aca None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:54.427609 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-77dcefb8-ca90-48d8-a409-bb49a9538aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:54.437256 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:32:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:54.771033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24534-2fb2-4d0a-96a1-b31d8b56810e None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:54.783521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24534-2fb2-4d0a-96a1-b31d8b56810e None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:54.788407 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd1c6f-b9d1-48cb-8a80-22ca4b0ec133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:54.789010 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1c6f-b9d1-48cb-8a80-22ca4b0ec133 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:54.789285 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1c6f-b9d1-48cb-8a80-22ca4b0ec133 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:54.789550 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1c6f-b9d1-48cb-8a80-22ca4b0ec133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:54.800539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd1c6f-b9d1-48cb-8a80-22ca4b0ec133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:54.802685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd1c6f-b9d1-48cb-8a80-22ca4b0ec133 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:54.817573 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 530/1063] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:57.336772 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d5ed-9456-4719-9d82-9a86a72d6028 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:57.337697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d5ed-9456-4719-9d82-9a86a72d6028 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:57.337697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d5ed-9456-4719-9d82-9a86a72d6028 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:57.339969 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:32:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:32:57.345530 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140768c-34d4-4a53-9249-d650609ac671 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:57.345947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140768c-34d4-4a53-9249-d650609ac671 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:57.346064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140768c-34d4-4a53-9249-d650609ac671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:57.366849 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-d140768c-34d4-4a53-9249-d650609ac671 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:32:57.368093 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-d140768c-34d4-4a53-9249-d650609ac671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:57.376096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:32:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:32:57.717298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9d5ed-9456-4719-9d82-9a86a72d6028 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:57.733254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9d5ed-9456-4719-9d82-9a86a72d6028 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:57.737160 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada86e67-9215-409e-bf8c-8f8b144282c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:57.737729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada86e67-9215-409e-bf8c-8f8b144282c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:57.738001 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada86e67-9215-409e-bf8c-8f8b144282c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:57.738267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada86e67-9215-409e-bf8c-8f8b144282c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:57.748114 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada86e67-9215-409e-bf8c-8f8b144282c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:57.749645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada86e67-9215-409e-bf8c-8f8b144282c2 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:57.759647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 535/1066] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:00.074245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20f16-06b3-4871-8472-898aa87be27b None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:00.074805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20f16-06b3-4871-8472-898aa87be27b None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:00.074805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20f16-06b3-4871-8472-898aa87be27b None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:00.076128 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:00.081792 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987582-1f54-44f3-b0ea-e478cc4b6ddd None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:00.082275 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987582-1f54-44f3-b0ea-e478cc4b6ddd None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:00.082373 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987582-1f54-44f3-b0ea-e478cc4b6ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:00.103517 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-a1987582-1f54-44f3-b0ea-e478cc4b6ddd None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:00.104786 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-a1987582-1f54-44f3-b0ea-e478cc4b6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:00.115647 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:33:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:33:00.464180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd20f16-06b3-4871-8472-898aa87be27b None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:00.476777 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd20f16-06b3-4871-8472-898aa87be27b None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:00.480379 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95538ea-eab3-4d33-b756-525331913b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:00.480974 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95538ea-eab3-4d33-b756-525331913b09 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:00.481245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95538ea-eab3-4d33-b756-525331913b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:00.481505 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95538ea-eab3-4d33-b756-525331913b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:00.491156 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95538ea-eab3-4d33-b756-525331913b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:00.492622 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95538ea-eab3-4d33-b756-525331913b09 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:00.502439 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 533/1069] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:02.768840 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab73f9c-03d2-4fa7-95c5-b9206526b160 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:02.769386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab73f9c-03d2-4fa7-95c5-b9206526b160 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:02.769386 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab73f9c-03d2-4fa7-95c5-b9206526b160 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:02.770971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:02.777434 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fbb57-85d7-43f3-bd87-9da8e33a0067 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:02.778186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fbb57-85d7-43f3-bd87-9da8e33a0067 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:02.778186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fbb57-85d7-43f3-bd87-9da8e33a0067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:02.801361 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-907fbb57-85d7-43f3-bd87-9da8e33a0067 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:02.802581 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-907fbb57-85d7-43f3-bd87-9da8e33a0067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:02.810966 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:33:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:03.148312 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab73f9c-03d2-4fa7-95c5-b9206526b160 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:03.163599 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab73f9c-03d2-4fa7-95c5-b9206526b160 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:03.168685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc536d-f502-4d24-b5a7-33f282f435fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:03.169283 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc536d-f502-4d24-b5a7-33f282f435fc service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:03.169554 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc536d-f502-4d24-b5a7-33f282f435fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:03.169820 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc536d-f502-4d24-b5a7-33f282f435fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:03.179691 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc536d-f502-4d24-b5a7-33f282f435fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:03.181148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc536d-f502-4d24-b5a7-33f282f435fc service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:03.190844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 538/1072] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:05.509699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbf482-124e-40c2-a586-2f6077d0b948 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:05.510257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbf482-124e-40c2-a586-2f6077d0b948 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:05.510257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbf482-124e-40c2-a586-2f6077d0b948 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:05.511623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:05.520683 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224635-d146-4604-9753-5588872bc377 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:05.521136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224635-d146-4604-9753-5588872bc377 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:05.521237 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224635-d146-4604-9753-5588872bc377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:05.550697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-72224635-d146-4604-9753-5588872bc377 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:05.551911 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-72224635-d146-4604-9753-5588872bc377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:05.563145 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:33:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:05.936638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbf482-124e-40c2-a586-2f6077d0b948 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:05.943110 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=64 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:05.950090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbf482-124e-40c2-a586-2f6077d0b948 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:05.954827 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d209df0-1014-4cb7-b6be-6e23b3d76dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:05.954827 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d209df0-1014-4cb7-b6be-6e23b3d76dda service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:05.954827 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d209df0-1014-4cb7-b6be-6e23b3d76dda service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:05.955182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d209df0-1014-4cb7-b6be-6e23b3d76dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:05.965822 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d209df0-1014-4cb7-b6be-6e23b3d76dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:05.967369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d209df0-1014-4cb7-b6be-6e23b3d76dda service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:05.976944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 536/1075] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:08.196119 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860df2ea-5228-44cf-b633-5860cb4078fd None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:08.196954 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860df2ea-5228-44cf-b633-5860cb4078fd None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:08.196954 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860df2ea-5228-44cf-b633-5860cb4078fd None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:08.198699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:33:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:08.210454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc67f8-9bcd-431d-99ff-67746bb26e7b None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:08.210992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc67f8-9bcd-431d-99ff-67746bb26e7b None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:08.210992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc67f8-9bcd-431d-99ff-67746bb26e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:08.237658 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-56bc67f8-9bcd-431d-99ff-67746bb26e7b None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:08.239577 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-56bc67f8-9bcd-431d-99ff-67746bb26e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:08.252303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:33:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:08.594497 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860df2ea-5228-44cf-b633-5860cb4078fd None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:08.601202 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=73 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:08.608451 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860df2ea-5228-44cf-b633-5860cb4078fd None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:08.612236 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eff98-73ec-4e7e-b930-565aa5b9582a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:08.612822 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eff98-73ec-4e7e-b930-565aa5b9582a service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:08.613115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eff98-73ec-4e7e-b930-565aa5b9582a service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:08.613402 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eff98-73ec-4e7e-b930-565aa5b9582a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:08.624991 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eff98-73ec-4e7e-b930-565aa5b9582a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:08.626438 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eff98-73ec-4e7e-b930-565aa5b9582a service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:08.636305 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 541/1078] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:10.898548 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773958-c575-4d35-9b63-5af97ea3f4bd None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:10.899180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773958-c575-4d35-9b63-5af97ea3f4bd None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:10.899180 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773958-c575-4d35-9b63-5af97ea3f4bd None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:10.900454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:10.906599 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24087e-d654-4b3f-850e-92bb304b8bee None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:10.907060 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24087e-d654-4b3f-850e-92bb304b8bee None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:10.907172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24087e-d654-4b3f-850e-92bb304b8bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:10.927787 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-7f24087e-d654-4b3f-850e-92bb304b8bee None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:10.928991 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-7f24087e-d654-4b3f-850e-92bb304b8bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:10.937727 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:33:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:11.287028 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32773958-c575-4d35-9b63-5af97ea3f4bd None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:11.299531 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32773958-c575-4d35-9b63-5af97ea3f4bd None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:11.303385 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9987-f8f2-41ef-9d6a-07728826540e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:11.303971 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9987-f8f2-41ef-9d6a-07728826540e service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:11.304239 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9987-f8f2-41ef-9d6a-07728826540e service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:11.304507 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9987-f8f2-41ef-9d6a-07728826540e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:11.313903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9987-f8f2-41ef-9d6a-07728826540e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:11.315373 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9987-f8f2-41ef-9d6a-07728826540e service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:11.324843 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 539/1081] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:33:13.541589 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7cb78-b523-4dda-a395-26b2bb1b4093 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:13.543984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7cb78-b523-4dda-a395-26b2bb1b4093 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:13.543984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7cb78-b523-4dda-a395-26b2bb1b4093 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:13.544523 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:33:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:13.550118 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ee19a-aebb-44da-8c6d-a85dac0591cd None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:13.550545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ee19a-aebb-44da-8c6d-a85dac0591cd None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:13.550657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ee19a-aebb-44da-8c6d-a85dac0591cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:13.572009 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-4b2ee19a-aebb-44da-8c6d-a85dac0591cd None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:13.573287 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-4b2ee19a-aebb-44da-8c6d-a85dac0591cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:13.582250 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:33:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:13.920611 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7cb78-b523-4dda-a395-26b2bb1b4093 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:13.937978 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7cb78-b523-4dda-a395-26b2bb1b4093 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:13.941985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5de450-d65d-4d7b-b77a-0bf26eda3a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:13.942570 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5de450-d65d-4d7b-b77a-0bf26eda3a95 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:13.942839 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5de450-d65d-4d7b-b77a-0bf26eda3a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:13.943148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5de450-d65d-4d7b-b77a-0bf26eda3a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:13.952240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5de450-d65d-4d7b-b77a-0bf26eda3a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:13.953670 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5de450-d65d-4d7b-b77a-0bf26eda3a95 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:13.963431 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 544/1084] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:16.179100 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687fbf1-ebb6-4e5c-8f85-6fd66d15fc76 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:16.179705 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687fbf1-ebb6-4e5c-8f85-6fd66d15fc76 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:16.179705 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687fbf1-ebb6-4e5c-8f85-6fd66d15fc76 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:16.181721 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:33:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:16.189371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9feb-afc5-45a3-95ab-d07e48639425 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:16.189782 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9feb-afc5-45a3-95ab-d07e48639425 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:16.189914 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9feb-afc5-45a3-95ab-d07e48639425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:16.211768 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-646f9feb-afc5-45a3-95ab-d07e48639425 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:16.212974 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-646f9feb-afc5-45a3-95ab-d07e48639425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:16.221955 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:33:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:16.571643 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687fbf1-ebb6-4e5c-8f85-6fd66d15fc76 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:16.586715 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687fbf1-ebb6-4e5c-8f85-6fd66d15fc76 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:16.590980 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655a704-f975-4b05-a830-cd187821890a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:16.591600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655a704-f975-4b05-a830-cd187821890a service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:16.591869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655a704-f975-4b05-a830-cd187821890a service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:16.592133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655a704-f975-4b05-a830-cd187821890a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:16.601673 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655a704-f975-4b05-a830-cd187821890a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:16.603165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655a704-f975-4b05-a830-cd187821890a service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:16.613157 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 542/1087] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:26.206041 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=17 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:26.608617 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=23 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:40.525396 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07460-9c93-4570-b725-7e70b397c626 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:40.526186 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07460-9c93-4570-b725-7e70b397c626 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:40.526186 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07460-9c93-4570-b725-7e70b397c626 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:40.527979 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 546/1088] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:40.533774 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ddece-0601-4f60-91dc-19c72ba51824 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:40.534201 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ddece-0601-4f60-91dc-19c72ba51824 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:40.534302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ddece-0601-4f60-91dc-19c72ba51824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:40.553600 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-027ddece-0601-4f60-91dc-19c72ba51824 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:40.555213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-027ddece-0601-4f60-91dc-19c72ba51824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:40.563358 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 543/1089] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:33:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:40.927769 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59bbaf-79db-4d93-af2e-224da400d0e8 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:40.928184 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59bbaf-79db-4d93-af2e-224da400d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:40.928601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59bbaf-79db-4d93-af2e-224da400d0e8 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:40.930704 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 547/1090] 10.222.0.69 () {54 vars in 967 bytes} [Fri Aug 19 02:33:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:40.939092 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0463c7-4bda-41ba-84c3-bb8a5e6f46c3 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:40.939392 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0463c7-4bda-41ba-84c3-bb8a5e6f46c3 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:40.939661 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0463c7-4bda-41ba-84c3-bb8a5e6f46c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:40.961819 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-3b0463c7-4bda-41ba-84c3-bb8a5e6f46c3 None None] MFA Rules not processed for user `3eb9db2887ee4e81aee4a4e2228f0add`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:40.963043 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-3b0463c7-4bda-41ba-84c3-bb8a5e6f46c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:40.970621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 544/1091] 10.222.0.69 () {58 vars in 1064 bytes} [Fri Aug 19 02:33:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:40.978855 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59bbaf-79db-4d93-af2e-224da400d0e8 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:40.999361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59bbaf-79db-4d93-af2e-224da400d0e8 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:41.005656 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815361ec-ca3c-48fa-8c7f-1ac07dd458d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eb9db2887ee4e81aee4a4e2228f0add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:41.006183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815361ec-ca3c-48fa-8c7f-1ac07dd458d2 service glance] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:41.006454 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815361ec-ca3c-48fa-8c7f-1ac07dd458d2 service glance] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:41.006715 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815361ec-ca3c-48fa-8c7f-1ac07dd458d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:41.016913 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815361ec-ca3c-48fa-8c7f-1ac07dd458d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:41.018330 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815361ec-ca3c-48fa-8c7f-1ac07dd458d2 service glance] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:41.028935 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 548/1092] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:33:43.307512 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a221e-f6ef-4ff4-8475-900e56859192 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:43.307512 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a221e-f6ef-4ff4-8475-900e56859192 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:43.308210 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a221e-f6ef-4ff4-8475-900e56859192 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:43.309136 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 545/1093] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:43.314824 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5551-c9a3-4562-87cc-97bb39f45618 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:43.315329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5551-c9a3-4562-87cc-97bb39f45618 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:43.315433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5551-c9a3-4562-87cc-97bb39f45618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:43.344238 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-bc6c5551-c9a3-4562-87cc-97bb39f45618 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:43.345455 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-bc6c5551-c9a3-4562-87cc-97bb39f45618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:43.358242 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 549/1094] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:33:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:43.685389 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a221e-f6ef-4ff4-8475-900e56859192 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:43.698842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a221e-f6ef-4ff4-8475-900e56859192 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:43.704630 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb2b99-d931-40b1-bf58-10a5166c7022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:43.705274 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2b99-d931-40b1-bf58-10a5166c7022 admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:43.705552 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2b99-d931-40b1-bf58-10a5166c7022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:43.705822 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2b99-d931-40b1-bf58-10a5166c7022 admin admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:43.706524 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb2b99-d931-40b1-bf58-10a5166c7022 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:43.708589 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING py.warnings [None req-5bfb2b99-d931-40b1-bf58-10a5166c7022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:33:43.708589 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: warnings.warn(msg) Aug 19 02:33:43.708589 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: Aug 19 02:33:43.711343 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb2b99-d931-40b1-bf58-10a5166c7022 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:43.736357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 546/1095] 10.222.0.69 () {56 vars in 1108 bytes} [Fri Aug 19 02:33:43 2022] GET /identity/v3/projects => generated 1606 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:33:45.940342 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c782-20dd-4bc7-aeeb-aa9cf150545b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:45.940996 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c782-20dd-4bc7-aeeb-aa9cf150545b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:45.940996 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c782-20dd-4bc7-aeeb-aa9cf150545b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:45.942266 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 550/1096] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:45.949096 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b83d1-46df-4788-854f-e46ec8121845 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:45.949627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b83d1-46df-4788-854f-e46ec8121845 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:45.950229 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b83d1-46df-4788-854f-e46ec8121845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:45.977304 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-356b83d1-46df-4788-854f-e46ec8121845 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:45.978427 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-356b83d1-46df-4788-854f-e46ec8121845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:45.987320 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 547/1097] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:33:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:46.337487 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c782-20dd-4bc7-aeeb-aa9cf150545b None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:46.353915 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c782-20dd-4bc7-aeeb-aa9cf150545b None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:46.360035 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa51123-58ff-423a-8fa6-9fc26db07cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:46.360664 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa51123-58ff-423a-8fa6-9fc26db07cf5 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:46.360931 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa51123-58ff-423a-8fa6-9fc26db07cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:46.361189 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa51123-58ff-423a-8fa6-9fc26db07cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:46.370695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa51123-58ff-423a-8fa6-9fc26db07cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:46.372456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa51123-58ff-423a-8fa6-9fc26db07cf5 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:46.383162 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 551/1098] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:48.795504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a48a9-d117-4604-aae7-1dcec42c2aaa None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:48.796115 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a48a9-d117-4604-aae7-1dcec42c2aaa None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:48.796115 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a48a9-d117-4604-aae7-1dcec42c2aaa None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:48.797564 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 548/1099] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:48.804479 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b9d5-daff-4870-a374-8d289442bd23 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:48.805104 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b9d5-daff-4870-a374-8d289442bd23 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:48.805104 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b9d5-daff-4870-a374-8d289442bd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:48.832306 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-2036b9d5-daff-4870-a374-8d289442bd23 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:48.833561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-2036b9d5-daff-4870-a374-8d289442bd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:48.842270 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 552/1100] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:33:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:49.179488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a48a9-d117-4604-aae7-1dcec42c2aaa None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:49.190521 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a48a9-d117-4604-aae7-1dcec42c2aaa None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:49.194084 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863eae-df0c-4e32-9aa8-0c5d0f07e0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:49.194691 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863eae-df0c-4e32-9aa8-0c5d0f07e0ed service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:49.194961 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863eae-df0c-4e32-9aa8-0c5d0f07e0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:49.195262 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863eae-df0c-4e32-9aa8-0c5d0f07e0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:49.204933 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863eae-df0c-4e32-9aa8-0c5d0f07e0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:49.206375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863eae-df0c-4e32-9aa8-0c5d0f07e0ed service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:49.217266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 549/1101] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:51.506338 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881222e7-fd52-40d0-97a0-780bd63be6f5 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:51.506970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881222e7-fd52-40d0-97a0-780bd63be6f5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:51.506970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881222e7-fd52-40d0-97a0-780bd63be6f5 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:51.508250 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 553/1102] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:51.514634 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c335f1-4805-4665-891b-50d9da6edecb None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:51.515430 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c335f1-4805-4665-891b-50d9da6edecb None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:51.515543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c335f1-4805-4665-891b-50d9da6edecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:51.549493 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-83c335f1-4805-4665-891b-50d9da6edecb None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:51.550921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-83c335f1-4805-4665-891b-50d9da6edecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:51.560512 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 550/1103] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:33:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:51.921228 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881222e7-fd52-40d0-97a0-780bd63be6f5 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:51.934425 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881222e7-fd52-40d0-97a0-780bd63be6f5 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:51.939115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f08e1-7668-4ff3-a3fd-4fc8485d5aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:51.939716 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f08e1-7668-4ff3-a3fd-4fc8485d5aca service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:51.939992 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f08e1-7668-4ff3-a3fd-4fc8485d5aca service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:51.940264 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f08e1-7668-4ff3-a3fd-4fc8485d5aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:51.949961 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f08e1-7668-4ff3-a3fd-4fc8485d5aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:51.951467 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f08e1-7668-4ff3-a3fd-4fc8485d5aca service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:51.961616 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 554/1104] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:54.251061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7167f-ab2c-4150-891f-38fffb1ae924 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:54.252059 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7167f-ab2c-4150-891f-38fffb1ae924 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:54.252059 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7167f-ab2c-4150-891f-38fffb1ae924 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:54.253650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 551/1105] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:54.260282 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf1a45-4f61-4486-93fe-e61c23a99698 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:54.260774 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf1a45-4f61-4486-93fe-e61c23a99698 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:54.260886 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf1a45-4f61-4486-93fe-e61c23a99698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:54.285182 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-22cf1a45-4f61-4486-93fe-e61c23a99698 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:54.286379 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-22cf1a45-4f61-4486-93fe-e61c23a99698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:54.295043 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 555/1106] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:33:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:54.639594 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7167f-ab2c-4150-891f-38fffb1ae924 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:54.653014 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7167f-ab2c-4150-891f-38fffb1ae924 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:54.656795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b850b7b-e0ac-4eb8-ae3f-8b79e9362ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:54.657519 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850b7b-e0ac-4eb8-ae3f-8b79e9362ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:54.657748 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850b7b-e0ac-4eb8-ae3f-8b79e9362ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:54.658015 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850b7b-e0ac-4eb8-ae3f-8b79e9362ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:54.670052 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b850b7b-e0ac-4eb8-ae3f-8b79e9362ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:54.673938 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b850b7b-e0ac-4eb8-ae3f-8b79e9362ce2 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:54.685458 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 552/1107] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:57.082699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ae80-4e5b-4159-873b-2876a95661bd None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:57.083298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ae80-4e5b-4159-873b-2876a95661bd None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:57.083298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192ae80-4e5b-4159-873b-2876a95661bd None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:57.084856 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 556/1108] 10.222.0.69 () {54 vars in 927 bytes} [Fri Aug 19 02:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:33:57.090751 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644a18-9ea9-49ea-a863-c33ff2bb583a None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:57.091255 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644a18-9ea9-49ea-a863-c33ff2bb583a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:57.091361 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644a18-9ea9-49ea-a863-c33ff2bb583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:57.116890 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-8c644a18-9ea9-49ea-a863-c33ff2bb583a None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:33:57.118144 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-8c644a18-9ea9-49ea-a863-c33ff2bb583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:57.127862 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 553/1109] 10.222.0.69 () {58 vars in 1024 bytes} [Fri Aug 19 02:33:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:33:57.479593 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192ae80-4e5b-4159-873b-2876a95661bd None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:57.494893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192ae80-4e5b-4159-873b-2876a95661bd None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:57.501575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606387c-1de3-4905-8c7c-911427702f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:57.502183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606387c-1de3-4905-8c7c-911427702f04 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:57.502424 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606387c-1de3-4905-8c7c-911427702f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:57.502684 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606387c-1de3-4905-8c7c-911427702f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:57.513128 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606387c-1de3-4905-8c7c-911427702f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:57.514565 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606387c-1de3-4905-8c7c-911427702f04 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:57.524393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 557/1110] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:34:07.111547 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=33 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:34:07.520159 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=33 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:35:10.689152 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1944-c0f1-4571-a91f-d8e17fa9c2a1 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:10.689855 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1944-c0f1-4571-a91f-d8e17fa9c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:10.689855 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1944-c0f1-4571-a91f-d8e17fa9c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:10.710803 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-f97b1944-c0f1-4571-a91f-d8e17fa9c2a1 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:35:10.712065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-f97b1944-c0f1-4571-a91f-d8e17fa9c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:35:10.720900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 554/1111] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:35:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:35:10.729516 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86d74-1d2d-479d-b392-f80b927323fc None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:10.730063 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86d74-1d2d-479d-b392-f80b927323fc None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:10.730168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86d74-1d2d-479d-b392-f80b927323fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:10.750670 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-3dd86d74-1d2d-479d-b392-f80b927323fc None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:35:10.751954 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-3dd86d74-1d2d-479d-b392-f80b927323fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:35:10.763133 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 558/1112] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:35:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:35:10.765977 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b1944-c0f1-4571-a91f-d8e17fa9c2a1 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:10.776209 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b1944-c0f1-4571-a91f-d8e17fa9c2a1 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:10.780984 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:10.781596 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:10.781878 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:10.782147 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:10.782805 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:35:10.783143 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:10.784165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING py.warnings [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:35:10.784165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: warnings.warn(msg) Aug 19 02:35:10.784165 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: Aug 19 02:35:10.785045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:10.797170 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 555/1113] 10.222.0.69 () {58 vars in 1153 bytes} [Fri Aug 19 02:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:35:10.805806 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86d74-1d2d-479d-b392-f80b927323fc None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:10.815648 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86d74-1d2d-479d-b392-f80b927323fc None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:10.820615 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:10.821235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:10.821507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:10.821778 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:10.822403 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:10.824282 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING py.warnings [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:35:10.824282 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: warnings.warn(msg) Aug 19 02:35:10.824282 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: Aug 19 02:35:10.825507 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:10.856321 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 559/1114] 10.222.0.69 () {60 vars in 1153 bytes} [Fri Aug 19 02:35:10 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:35:10.860699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:10.870854 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2cfec-d6af-4299-bcae-5f91dec625cc admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:10.931505 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:10.932120 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:10.932394 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:10.932666 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:10.933326 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:10.934352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING py.warnings [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:35:10.934352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: warnings.warn(msg) Aug 19 02:35:10.934352 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: Aug 19 02:35:10.935612 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:10.960842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 556/1115] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:35:10 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:35:10.965751 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:10.979211 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5e305-3186-46e6-9797-6fff9104cb9d admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:10.984046 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:10.984852 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:10.985127 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:10.985394 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:10.986043 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:10.987100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING py.warnings [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:35:10.987100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: warnings.warn(msg) Aug 19 02:35:10.987100 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: Aug 19 02:35:10.987995 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:11.002919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 560/1116] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:35:11.007378 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:11.017900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e1608-ff04-4a40-ae4b-9dec579ce39c admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:11.022796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da86f2b-5764-414c-a34d-7d89373fdab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:11.023437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da86f2b-5764-414c-a34d-7d89373fdab1 admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.023707 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da86f2b-5764-414c-a34d-7d89373fdab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.023971 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da86f2b-5764-414c-a34d-7d89373fdab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.024786 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da86f2b-5764-414c-a34d-7d89373fdab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:11.025846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING py.warnings [None req-7da86f2b-5764-414c-a34d-7d89373fdab1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:35:11.025846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: warnings.warn(msg) Aug 19 02:35:11.025846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: Aug 19 02:35:11.026728 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da86f2b-5764-414c-a34d-7d89373fdab1 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:11.040900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 557/1117] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:35:11.047413 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:11.057807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff4f5b-67d2-4da5-a25d-c17439389f78 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:11.062756 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014fd73-ec43-4348-bf19-6b4fc62f86b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:11.063470 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014fd73-ec43-4348-bf19-6b4fc62f86b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.063746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014fd73-ec43-4348-bf19-6b4fc62f86b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.064014 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014fd73-ec43-4348-bf19-6b4fc62f86b5 admin admin] PATH_INFO: `/v3/projects/696240777d0e4957b68b7d88806ae6c2/users/31ca2847be5046ecb468c04351ed426a/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.081491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014fd73-ec43-4348-bf19-6b4fc62f86b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696240777d0e4957b68b7d88806ae6c2, user_id=31ca2847be5046ecb468c04351ed426a, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:11.082550 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING py.warnings [None req-9014fd73-ec43-4348-bf19-6b4fc62f86b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:35:11.082550 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: warnings.warn(msg) Aug 19 02:35:11.082550 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: Aug 19 02:35:11.084909 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014fd73-ec43-4348-bf19-6b4fc62f86b5 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:11.101319 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 561/1118] 10.222.0.69 () {60 vars in 1483 bytes} [Fri Aug 19 02:35:11 2022] PUT /identity/v3/projects/696240777d0e4957b68b7d88806ae6c2/users/31ca2847be5046ecb468c04351ed426a/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:35:11.114139 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0cef-3583-4ff0-8cc9-fe7212e2e243 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.114422 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0cef-3583-4ff0-8cc9-fe7212e2e243 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.114691 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0cef-3583-4ff0-8cc9-fe7212e2e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.145653 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-5e5d0cef-3583-4ff0-8cc9-fe7212e2e243 None None] MFA Rules not processed for user `31ca2847be5046ecb468c04351ed426a`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:35:11.146877 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-5e5d0cef-3583-4ff0-8cc9-fe7212e2e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:35:11.214357 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 558/1119] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:35:11 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:35:11.228110 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f7af-6b2e-43dd-8ebb-0c9cf14e552b None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.228110 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f7af-6b2e-43dd-8ebb-0c9cf14e552b None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.228393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f7af-6b2e-43dd-8ebb-0c9cf14e552b None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.229695 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 562/1120] 10.222.0.69 () {54 vars in 964 bytes} [Fri Aug 19 02:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:35:11.234903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c5f8-6779-4522-ab4c-dca4655deb6d None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.235212 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c5f8-6779-4522-ab4c-dca4655deb6d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.235490 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c5f8-6779-4522-ab4c-dca4655deb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.255265 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-ff68c5f8-6779-4522-ab4c-dca4655deb6d None None] MFA Rules not processed for user `5c679a1bdee541f2830dce7ee89e60f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:35:11.256451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-ff68c5f8-6779-4522-ab4c-dca4655deb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:35:11.302650 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:35:11.312520 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 559/1121] 10.222.0.69 () {58 vars in 1061 bytes} [Fri Aug 19 02:35:11 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:35:11.320539 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2f7af-6b2e-43dd-8ebb-0c9cf14e552b None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:11.332543 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2f7af-6b2e-43dd-8ebb-0c9cf14e552b None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:11.336627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea897a85-04f1-44e3-a388-fe718e814bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c679a1bdee541f2830dce7ee89e60f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:11.337309 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea897a85-04f1-44e3-a388-fe718e814bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.337589 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea897a85-04f1-44e3-a388-fe718e814bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.337843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea897a85-04f1-44e3-a388-fe718e814bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.346407 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea897a85-04f1-44e3-a388-fe718e814bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:11.348131 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea897a85-04f1-44e3-a388-fe718e814bc2 service cinder] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:11.358061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 563/1122] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:35:11 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:35:11.396310 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a03d-7b71-40ea-bf81-91b981cc8c1a None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.396597 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a03d-7b71-40ea-bf81-91b981cc8c1a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.396871 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a03d-7b71-40ea-bf81-91b981cc8c1a None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.398114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 560/1123] 10.222.0.69 () {52 vars in 830 bytes} [Fri Aug 19 02:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:35:11.401993 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea897a85-04f1-44e3-a388-fe718e814bc2 service cinder] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:11.467848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea897a85-04f1-44e3-a388-fe718e814bc2 service cinder] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:11.472785 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:11.473412 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.473688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.473957 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] PATH_INFO: `/v3/users/31ca2847be5046ecb468c04351ed426a` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.475144 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ca2847be5046ecb468c04351ed426a)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:11.476151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING py.warnings [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:35:11.476151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: warnings.warn(msg) Aug 19 02:35:11.476151 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: Aug 19 02:35:11.477371 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:11.543984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ca2847be5046ecb468c04351ed426a'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:11.567644 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ca2847be5046ecb468c04351ed426a'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:11.568398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ca2847be5046ecb468c04351ed426a'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:11.569183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ca2847be5046ecb468c04351ed426a'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:11.583831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ca2847be5046ecb468c04351ed426a'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:11.600005 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 564/1124] 10.222.0.69 () {58 vars in 1224 bytes} [Fri Aug 19 02:35:11 2022] DELETE /identity/v3/users/31ca2847be5046ecb468c04351ed426a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:35:11.604846 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9911a-1c31-4c9f-b084-711ea01e9648 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.605186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9911a-1c31-4c9f-b084-711ea01e9648 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.605456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9911a-1c31-4c9f-b084-711ea01e9648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.625077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-b1b9911a-1c31-4c9f-b084-711ea01e9648 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:35:11.626307 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b1b9911a-1c31-4c9f-b084-711ea01e9648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:35:11.685081 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 561/1125] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:35:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:35:11.694903 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:11.696680 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:35:11.702498 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:35:11.757937 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cfb9b-b5e6-49a6-8dd2-6c338cf7bff4 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:11.761722 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81532c9-41f4-4b39-9ba3-5c7bad334a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:11.762344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81532c9-41f4-4b39-9ba3-5c7bad334a47 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:11.762614 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81532c9-41f4-4b39-9ba3-5c7bad334a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:11.762880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81532c9-41f4-4b39-9ba3-5c7bad334a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:11.773013 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81532c9-41f4-4b39-9ba3-5c7bad334a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:11.774489 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81532c9-41f4-4b39-9ba3-5c7bad334a47 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:11.784764 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 565/1126] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:35:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:35:12.120186 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9911a-1c31-4c9f-b084-711ea01e9648 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:35:12.121690 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-b1b9911a-1c31-4c9f-b084-711ea01e9648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:35:12.133913 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9911a-1c31-4c9f-b084-711ea01e9648 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:35:12.140527 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:35:12.141273 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:35:12.141500 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:35:12.141774 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] PATH_INFO: `/v3/projects/696240777d0e4957b68b7d88806ae6c2` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:35:12.143691 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=696240777d0e4957b68b7d88806ae6c2)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:35:12.144899 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING py.warnings [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:35:12.144899 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: warnings.warn(msg) Aug 19 02:35:12.144899 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: Aug 19 02:35:12.146097 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:35:12.210456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696240777d0e4957b68b7d88806ae6c2', 'request_id': 'req-077bd1ea-4fff-4153-bb4e-514e3a3943ba'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:12.224668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696240777d0e4957b68b7d88806ae6c2', 'request_id': 'req-077bd1ea-4fff-4153-bb4e-514e3a3943ba'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:12.235809 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696240777d0e4957b68b7d88806ae6c2', 'request_id': 'req-077bd1ea-4fff-4153-bb4e-514e3a3943ba'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:12.246714 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] The token cache is being invalidate because project 696240777d0e4957b68b7d88806ae6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:35:12.247018 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:12.247663 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-077bd1ea-4fff-4153-bb4e-514e3a3943ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:35:12.249279 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 562/1127] 10.222.0.69 () {58 vars in 1233 bytes} [Fri Aug 19 02:35:12 2022] DELETE /identity/v3/projects/696240777d0e4957b68b7d88806ae6c2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:35:21.780204 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=25 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:35:22.243828 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:36:35.888991 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc10dc-b23e-4634-9dd9-be2f898f3956 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:35.889601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc10dc-b23e-4634-9dd9-be2f898f3956 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:35.889601 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc10dc-b23e-4634-9dd9-be2f898f3956 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:35.890899 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:36:35.896006 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9fe9-e87e-48bd-9165-ed1bc2c7095d None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:35.896454 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9fe9-e87e-48bd-9165-ed1bc2c7095d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:35.896560 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9fe9-e87e-48bd-9165-ed1bc2c7095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:35.967993 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-15cd9fe9-e87e-48bd-9165-ed1bc2c7095d None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:36:35.969222 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-15cd9fe9-e87e-48bd-9165-ed1bc2c7095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:36:36.066858 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:36:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:36:36.223942 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc10dc-b23e-4634-9dd9-be2f898f3956 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:36:36.225715 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-76cc10dc-b23e-4634-9dd9-be2f898f3956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:36:36.314512 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc10dc-b23e-4634-9dd9-be2f898f3956 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:36:36.319762 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee601ccf-f9da-4238-bdd8-48ff9be255f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:36:36.320298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601ccf-f9da-4238-bdd8-48ff9be255f1 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:36.320738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601ccf-f9da-4238-bdd8-48ff9be255f1 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:36.321031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601ccf-f9da-4238-bdd8-48ff9be255f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:36.329354 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee601ccf-f9da-4238-bdd8-48ff9be255f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:36:36.330929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee601ccf-f9da-4238-bdd8-48ff9be255f1 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:36:36.340833 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 567/1130] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:36:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:36:37.168346 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78437b-13f3-4368-8895-5dc766203e2d None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:37.169090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78437b-13f3-4368-8895-5dc766203e2d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:37.169090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78437b-13f3-4368-8895-5dc766203e2d None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:37.170416 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:36:37.175732 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2b104-0669-411a-a43d-0a2587b20dd5 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:37.176190 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2b104-0669-411a-a43d-0a2587b20dd5 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:37.176296 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2b104-0669-411a-a43d-0a2587b20dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:37.196435 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-14e2b104-0669-411a-a43d-0a2587b20dd5 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:36:37.197685 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-14e2b104-0669-411a-a43d-0a2587b20dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:36:37.205908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:36:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:36:37.361944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78437b-13f3-4368-8895-5dc766203e2d None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:36:37.377323 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78437b-13f3-4368-8895-5dc766203e2d None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:36:37.382954 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f847e-e0d5-49ad-a632-20214e5a0585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:36:37.383945 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f847e-e0d5-49ad-a632-20214e5a0585 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:37.383945 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f847e-e0d5-49ad-a632-20214e5a0585 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:37.384178 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f847e-e0d5-49ad-a632-20214e5a0585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:37.394061 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f847e-e0d5-49ad-a632-20214e5a0585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:36:37.395734 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f847e-e0d5-49ad-a632-20214e5a0585 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:36:37.405396 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 565/1133] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:36:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:36:42.003832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1db6a-2f48-48bd-9ec5-95d702bf45d3 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:42.004429 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1db6a-2f48-48bd-9ec5-95d702bf45d3 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:42.004429 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1db6a-2f48-48bd-9ec5-95d702bf45d3 None None] PATH_INFO: `/v3` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:42.005740 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 569/1134] 10.222.0.20 () {54 vars in 925 bytes} [Fri Aug 19 02:36:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:36:42.013641 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db712-ddfa-408d-a8ba-b7c9a858e13d None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:42.014105 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db712-ddfa-408d-a8ba-b7c9a858e13d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:42.014406 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db712-ddfa-408d-a8ba-b7c9a858e13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:42.055309 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-a01db712-ddfa-408d-a8ba-b7c9a858e13d None None] MFA Rules not processed for user `530e9c679e6041f491eb9a93a74cc118`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:36:42.057024 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-a01db712-ddfa-408d-a8ba-b7c9a858e13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:36:42.121187 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:36:42.131098 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 566/1135] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 19 02:36:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:36:47.191493 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=42 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:36:48.682932 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5321-5dbd-4704-83b8-cc426b4c448e None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:48.683677 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5321-5dbd-4704-83b8-cc426b4c448e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:48.683677 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5321-5dbd-4704-83b8-cc426b4c448e None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:48.684846 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:36:48.690032 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43a0b-e712-43d6-b971-275d5c086558 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:48.690511 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43a0b-e712-43d6-b971-275d5c086558 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:48.690624 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43a0b-e712-43d6-b971-275d5c086558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:48.712247 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-daf43a0b-e712-43d6-b971-275d5c086558 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:36:48.713444 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-daf43a0b-e712-43d6-b971-275d5c086558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:36:48.722763 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:36:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:36:48.882385 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb5321-5dbd-4704-83b8-cc426b4c448e None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:36:48.896890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb5321-5dbd-4704-83b8-cc426b4c448e None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:36:48.902045 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb942a1-ce1f-4624-8baf-36a345e6962c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:36:48.902669 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb942a1-ce1f-4624-8baf-36a345e6962c service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:48.902940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb942a1-ce1f-4624-8baf-36a345e6962c service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:48.903235 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb942a1-ce1f-4624-8baf-36a345e6962c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:48.911624 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb942a1-ce1f-4624-8baf-36a345e6962c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:36:48.913192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb942a1-ce1f-4624-8baf-36a345e6962c service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:36:48.922629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 571/1138] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:36:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:36:49.744943 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aac92-4107-4ade-a893-3846e1fe1869 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:49.745654 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aac92-4107-4ade-a893-3846e1fe1869 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:49.745833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aac92-4107-4ade-a893-3846e1fe1869 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:49.748321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:36:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:36:49.753738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23284c84-825f-4072-a1de-3dd9455ba35d None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:49.754186 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23284c84-825f-4072-a1de-3dd9455ba35d None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:49.754290 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23284c84-825f-4072-a1de-3dd9455ba35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:49.776273 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-23284c84-825f-4072-a1de-3dd9455ba35d None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:36:49.777568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-23284c84-825f-4072-a1de-3dd9455ba35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:36:49.786441 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:36:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:36:49.942926 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aac92-4107-4ade-a893-3846e1fe1869 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:36:49.958706 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aac92-4107-4ade-a893-3846e1fe1869 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:36:49.964412 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf38db-08b4-4498-9e31-a21eb9067b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:36:49.965008 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf38db-08b4-4498-9e31-a21eb9067b5e service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:49.965286 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf38db-08b4-4498-9e31-a21eb9067b5e service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:49.965548 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf38db-08b4-4498-9e31-a21eb9067b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:49.974167 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf38db-08b4-4498-9e31-a21eb9067b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:36:49.975778 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf38db-08b4-4498-9e31-a21eb9067b5e service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:36:49.985331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 569/1141] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:36:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:36:51.636485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67deb2-3886-428b-a022-44d4212f3a71 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:51.637068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67deb2-3886-428b-a022-44d4212f3a71 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:51.637068 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67deb2-3886-428b-a022-44d4212f3a71 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:51.638364 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 573/1142] 10.222.0.69 () {54 vars in 961 bytes} [Fri Aug 19 02:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:36:51.643436 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12436-6563-4b35-8fb3-819056bd59cf None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:51.643883 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12436-6563-4b35-8fb3-819056bd59cf None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:51.643987 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12436-6563-4b35-8fb3-819056bd59cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:51.663595 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-0be12436-6563-4b35-8fb3-819056bd59cf None None] MFA Rules not processed for user `530e9c679e6041f491eb9a93a74cc118`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:36:51.664785 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-0be12436-6563-4b35-8fb3-819056bd59cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:36:51.673742 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 570/1143] 10.222.0.69 () {58 vars in 1058 bytes} [Fri Aug 19 02:36:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:36:51.681344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67deb2-3886-428b-a022-44d4212f3a71 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:36:51.697186 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67deb2-3886-428b-a022-44d4212f3a71 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:36:51.703330 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0525c-6dfd-4949-be45-27f24bb367b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530e9c679e6041f491eb9a93a74cc118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:36:51.703940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0525c-6dfd-4949-be45-27f24bb367b3 service placement] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:36:51.704217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0525c-6dfd-4949-be45-27f24bb367b3 service placement] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:36:51.704485 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0525c-6dfd-4949-be45-27f24bb367b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:36:51.713596 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0525c-6dfd-4949-be45-27f24bb367b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:36:51.715223 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0525c-6dfd-4949-be45-27f24bb367b3 service placement] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:36:51.725505 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 574/1144] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:36:51 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:37:01.246406 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6e89-16e5-4034-8060-6e8303551b9d None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:01.247050 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6e89-16e5-4034-8060-6e8303551b9d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:01.247050 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6e89-16e5-4034-8060-6e8303551b9d None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:01.248342 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:37:01.253344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130db85-2262-48e3-b9f4-e6e85ceb88d4 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:01.253800 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130db85-2262-48e3-b9f4-e6e85ceb88d4 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:01.253906 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130db85-2262-48e3-b9f4-e6e85ceb88d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:01.274597 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-5130db85-2262-48e3-b9f4-e6e85ceb88d4 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:37:01.275851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-5130db85-2262-48e3-b9f4-e6e85ceb88d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:01.286832 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:37:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:37:01.465569 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd6e89-16e5-4034-8060-6e8303551b9d None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:37:01.479657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd6e89-16e5-4034-8060-6e8303551b9d None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:37:01.485271 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92826da9-79a4-437a-9f4b-018d3d2c2c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:37:01.485887 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826da9-79a4-437a-9f4b-018d3d2c2c99 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:01.486163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826da9-79a4-437a-9f4b-018d3d2c2c99 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:01.486433 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826da9-79a4-437a-9f4b-018d3d2c2c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:01.494806 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92826da9-79a4-437a-9f4b-018d3d2c2c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:37:01.496553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92826da9-79a4-437a-9f4b-018d3d2c2c99 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:37:01.506508 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 572/1147] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:37:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:37:02.324017 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e539-777b-4877-a1ed-204095daa054 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:02.324607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e539-777b-4877-a1ed-204095daa054 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:02.324607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e539-777b-4877-a1ed-204095daa054 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:02.326000 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:37:02.331242 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf424-b922-4c49-8f52-281607495a45 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:02.331903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf424-b922-4c49-8f52-281607495a45 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:02.332184 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf424-b922-4c49-8f52-281607495a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:02.352986 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-0adaf424-b922-4c49-8f52-281607495a45 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:37:02.354183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-0adaf424-b922-4c49-8f52-281607495a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:02.362538 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:37:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:37:02.518388 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e539-777b-4877-a1ed-204095daa054 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:37:02.533490 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e539-777b-4877-a1ed-204095daa054 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:37:02.539373 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabfc1b-4b1d-4f2f-bac2-bbb964eedd23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:37:02.539958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabfc1b-4b1d-4f2f-bac2-bbb964eedd23 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:02.540240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabfc1b-4b1d-4f2f-bac2-bbb964eedd23 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:02.540508 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabfc1b-4b1d-4f2f-bac2-bbb964eedd23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:02.549023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabfc1b-4b1d-4f2f-bac2-bbb964eedd23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:37:02.550617 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabfc1b-4b1d-4f2f-bac2-bbb964eedd23 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:37:02.560105 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 577/1150] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:37:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:37:06.782559 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb79d-eb8e-48f6-86f9-9fa34236436e None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:06.783114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb79d-eb8e-48f6-86f9-9fa34236436e None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:06.783114 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb79d-eb8e-48f6-86f9-9fa34236436e None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:06.784482 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:37:06.790135 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709077c7-2775-45a1-9ad9-224108b21a25 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:06.790658 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709077c7-2775-45a1-9ad9-224108b21a25 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:06.790658 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709077c7-2775-45a1-9ad9-224108b21a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:06.812220 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-709077c7-2775-45a1-9ad9-224108b21a25 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:37:06.813450 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-709077c7-2775-45a1-9ad9-224108b21a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:06.823298 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:37:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:37:07.163321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eb79d-eb8e-48f6-86f9-9fa34236436e None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:37:07.165138 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-706eb79d-eb8e-48f6-86f9-9fa34236436e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:07.231825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eb79d-eb8e-48f6-86f9-9fa34236436e None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:37:07.235376 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d1d8a-7cd5-418f-a566-4a857d6b8040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:37:07.235987 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d1d8a-7cd5-418f-a566-4a857d6b8040 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:07.236258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d1d8a-7cd5-418f-a566-4a857d6b8040 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:07.236520 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d1d8a-7cd5-418f-a566-4a857d6b8040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:07.245583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d1d8a-7cd5-418f-a566-4a857d6b8040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:37:07.247372 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d1d8a-7cd5-418f-a566-4a857d6b8040 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:37:07.257616 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 575/1153] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:37:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:37:09.428984 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3b13-29e3-4bfe-b75e-5084f76dedb6 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:09.429645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3b13-29e3-4bfe-b75e-5084f76dedb6 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:09.429645 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3b13-29e3-4bfe-b75e-5084f76dedb6 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:09.431597 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:37:09.439383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6520b-a5eb-4b1b-9014-96f58bed2ce2 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:09.439842 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6520b-a5eb-4b1b-9014-96f58bed2ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:09.439947 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6520b-a5eb-4b1b-9014-96f58bed2ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:09.464610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-67d6520b-a5eb-4b1b-9014-96f58bed2ce2 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:37:09.465833 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-67d6520b-a5eb-4b1b-9014-96f58bed2ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:09.473869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:37:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:37:09.812473 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b3b13-29e3-4bfe-b75e-5084f76dedb6 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:37:09.814667 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-e74b3b13-29e3-4bfe-b75e-5084f76dedb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:09.829752 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b3b13-29e3-4bfe-b75e-5084f76dedb6 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:37:09.834128 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98c00-fb10-4c37-a733-0e558b883681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:37:09.834753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98c00-fb10-4c37-a733-0e558b883681 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:09.835054 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98c00-fb10-4c37-a733-0e558b883681 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:09.835325 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98c00-fb10-4c37-a733-0e558b883681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:09.845215 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e98c00-fb10-4c37-a733-0e558b883681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:37:09.846652 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e98c00-fb10-4c37-a733-0e558b883681 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:37:09.856320 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 580/1156] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:37:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:37:13.665336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803aca8-1fcf-41c6-9378-625aeef2f74a None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:13.665953 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803aca8-1fcf-41c6-9378-625aeef2f74a None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:13.665953 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803aca8-1fcf-41c6-9378-625aeef2f74a None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:13.667266 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 577/1157] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:37:13.672931 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14096f7f-c302-4574-8671-30da21f0d85e None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:13.673433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14096f7f-c302-4574-8671-30da21f0d85e None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:13.673433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14096f7f-c302-4574-8671-30da21f0d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:13.693335 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-14096f7f-c302-4574-8671-30da21f0d85e None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:37:13.694543 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-14096f7f-c302-4574-8671-30da21f0d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:13.702701 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 581/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:37:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:37:14.274490 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803aca8-1fcf-41c6-9378-625aeef2f74a None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:37:14.276339 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-1803aca8-1fcf-41c6-9378-625aeef2f74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:14.282389 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=51 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:37:14.346076 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803aca8-1fcf-41c6-9378-625aeef2f74a None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:37:14.349687 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0054a9-effd-488d-a869-8cc55c0201f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c679a1bdee541f2830dce7ee89e60f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:37:14.350313 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0054a9-effd-488d-a869-8cc55c0201f8 service cinder] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:14.350582 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0054a9-effd-488d-a869-8cc55c0201f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:14.350856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0054a9-effd-488d-a869-8cc55c0201f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:14.360086 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0054a9-effd-488d-a869-8cc55c0201f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:37:14.361545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0054a9-effd-488d-a869-8cc55c0201f8 service cinder] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:37:14.370942 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 578/1159] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:37:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:37:16.549699 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d7b7-b28c-4b1c-aed5-aa53936b2c3d None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:16.550268 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d7b7-b28c-4b1c-aed5-aa53936b2c3d None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:16.550268 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d7b7-b28c-4b1c-aed5-aa53936b2c3d None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:16.551626 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 582/1160] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:37:16.557162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759172ff-0184-4af9-98ca-e4a00d3170e6 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:16.557610 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759172ff-0184-4af9-98ca-e4a00d3170e6 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:16.557703 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759172ff-0184-4af9-98ca-e4a00d3170e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:16.577758 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-759172ff-0184-4af9-98ca-e4a00d3170e6 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:37:16.579025 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-759172ff-0184-4af9-98ca-e4a00d3170e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:16.588735 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 579/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:37:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:37:17.158766 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552d7b7-b28c-4b1c-aed5-aa53936b2c3d None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:37:17.160922 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-8552d7b7-b28c-4b1c-aed5-aa53936b2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:17.175857 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552d7b7-b28c-4b1c-aed5-aa53936b2c3d None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:37:17.180093 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b1989-45bb-40ec-af9e-b912942dd6ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c679a1bdee541f2830dce7ee89e60f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:37:17.180696 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1989-45bb-40ec-af9e-b912942dd6ea service cinder] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:17.181039 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1989-45bb-40ec-af9e-b912942dd6ea service cinder] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:17.181374 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1989-45bb-40ec-af9e-b912942dd6ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:17.191476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b1989-45bb-40ec-af9e-b912942dd6ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:37:17.193104 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b1989-45bb-40ec-af9e-b912942dd6ea service cinder] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:37:17.197113 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=41 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:37:17.204707 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 583/1162] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:37:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:37:26.572769 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=28 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:37:27.201058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:31.785456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ff9e3-129d-47ca-ae78-0bb05bb1aeb7 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:31.786099 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ff9e3-129d-47ca-ae78-0bb05bb1aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:31.786099 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ff9e3-129d-47ca-ae78-0bb05bb1aeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:31.806191 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-fa9ff9e3-129d-47ca-ae78-0bb05bb1aeb7 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:31.817582 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-fa9ff9e3-129d-47ca-ae78-0bb05bb1aeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:31.820422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96bb12-dc48-4fc1-bc4a-0054924d2db4 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:31.820954 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96bb12-dc48-4fc1-bc4a-0054924d2db4 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:31.820954 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96bb12-dc48-4fc1-bc4a-0054924d2db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:31.826792 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 580/1163] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:38:31.835660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bfa5-20cc-49ce-9c2e-d890cd0c8b3e None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:31.835925 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bfa5-20cc-49ce-9c2e-d890cd0c8b3e None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:31.836217 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bfa5-20cc-49ce-9c2e-d890cd0c8b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:31.841126 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-ce96bb12-dc48-4fc1-bc4a-0054924d2db4 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:31.842377 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-ce96bb12-dc48-4fc1-bc4a-0054924d2db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:31.857758 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-4997bfa5-20cc-49ce-9c2e-d890cd0c8b3e None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:31.858222 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 584/1164] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:38:31.858979 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-4997bfa5-20cc-49ce-9c2e-d890cd0c8b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:31.866951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488a8f2-91cb-487f-9f0c-1a9430a6ca8a None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:31.867807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488a8f2-91cb-487f-9f0c-1a9430a6ca8a None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:31.867807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488a8f2-91cb-487f-9f0c-1a9430a6ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:31.868133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 581/1165] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:31.872416 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997bfa5-20cc-49ce-9c2e-d890cd0c8b3e None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:31.882284 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997bfa5-20cc-49ce-9c2e-d890cd0c8b3e None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:31.887125 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:31.887841 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:31.888117 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:31.888387 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] PATH_INFO: `/v3/domains` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:31.889046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:38:31.889351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:31.890976 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:31.893531 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-a488a8f2-91cb-487f-9f0c-1a9430a6ca8a None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:31.894757 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-a488a8f2-91cb-487f-9f0c-1a9430a6ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:31.903150 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 585/1166] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:38:31.903724 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 582/1167] 10.222.0.69 () {58 vars in 1153 bytes} [Fri Aug 19 02:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:38:31.907764 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488a8f2-91cb-487f-9f0c-1a9430a6ca8a None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:31.911655 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:31.916820 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488a8f2-91cb-487f-9f0c-1a9430a6ca8a None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:31.921391 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:31.921766 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24febbf-c5ec-4f14-93a8-6c956e54dcae admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:31.921983 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:31.922251 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:31.922515 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] PATH_INFO: `/v3/domains` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:31.923192 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:38:31.923491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:31.924506 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING py.warnings [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:38:31.924506 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: warnings.warn(msg) Aug 19 02:38:31.924506 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: Aug 19 02:38:31.925380 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:31.926443 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:31.927064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:31.927364 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:31.927638 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:31.928270 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:31.929464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING py.warnings [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:38:31.929464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: warnings.warn(msg) Aug 19 02:38:31.929464 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: Aug 19 02:38:31.930640 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:31.937319 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 586/1168] 10.222.0.69 () {58 vars in 1153 bytes} [Fri Aug 19 02:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:38:31.945244 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:31.954893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f908-b310-4129-8189-8fecf9076286 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:31.960269 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e2af8-2d52-45c5-ac63-a4125b1d48f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:31.961013 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e2af8-2d52-45c5-ac63-a4125b1d48f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:31.961280 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e2af8-2d52-45c5-ac63-a4125b1d48f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:31.961594 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e2af8-2d52-45c5-ac63-a4125b1d48f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:31.962389 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e2af8-2d52-45c5-ac63-a4125b1d48f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:31.964433 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e2af8-2d52-45c5-ac63-a4125b1d48f7 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:31.974583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 583/1169] 10.222.0.69 () {60 vars in 1153 bytes} [Fri Aug 19 02:38:31 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:38:31.975619 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:31.994175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 587/1170] 10.222.0.69 () {60 vars in 1153 bytes} [Fri Aug 19 02:38:31 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:38:31.998738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e2af8-2d52-45c5-ac63-a4125b1d48f7 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.041924 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb728b88-bc18-4a2b-8041-5f8685ecea1b admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.060810 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e2af8-2d52-45c5-ac63-a4125b1d48f7 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.066143 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.066758 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.067062 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.067340 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.067966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.068990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING py.warnings [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:38:32.068990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: warnings.warn(msg) Aug 19 02:38:32.068990 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: Aug 19 02:38:32.070214 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.093882 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 588/1171] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:38:31 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:38:32.097979 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.100568 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e33bf-3b9e-4e8c-9bf7-7099426ed5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.101183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e33bf-3b9e-4e8c-9bf7-7099426ed5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.101460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e33bf-3b9e-4e8c-9bf7-7099426ed5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.101736 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e33bf-3b9e-4e8c-9bf7-7099426ed5f9 admin admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.102364 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e33bf-3b9e-4e8c-9bf7-7099426ed5f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.104331 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e33bf-3b9e-4e8c-9bf7-7099426ed5f9 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.107409 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a087-2630-406c-b900-c843a06bad93 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.111987 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb331958-55f4-42be-ab58-ecd00f6a2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.112577 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb331958-55f4-42be-ab58-ecd00f6a2717 admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.112851 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb331958-55f4-42be-ab58-ecd00f6a2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.113115 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb331958-55f4-42be-ab58-ecd00f6a2717 admin admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.113746 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb331958-55f4-42be-ab58-ecd00f6a2717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.115572 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb331958-55f4-42be-ab58-ecd00f6a2717 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.128065 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 584/1172] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:38:31 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:38:32.131205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 589/1173] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:38:32.132588 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb331958-55f4-42be-ab58-ecd00f6a2717 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.132740 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e33bf-3b9e-4e8c-9bf7-7099426ed5f9 admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.142771 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e33bf-3b9e-4e8c-9bf7-7099426ed5f9 admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.144116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb331958-55f4-42be-ab58-ecd00f6a2717 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.147338 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bd88d-a60f-4f8b-a86d-aa84cf12cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.148395 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd88d-a60f-4f8b-a86d-aa84cf12cdfd admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.148568 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd88d-a60f-4f8b-a86d-aa84cf12cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.148862 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7fa8-8126-4bf2-af4f-7e3258e18d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.149022 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd88d-a60f-4f8b-a86d-aa84cf12cdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.149393 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7fa8-8126-4bf2-af4f-7e3258e18d94 admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.149497 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bd88d-a60f-4f8b-a86d-aa84cf12cdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.149665 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7fa8-8126-4bf2-af4f-7e3258e18d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.149928 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7fa8-8126-4bf2-af4f-7e3258e18d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.150557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7fa8-8126-4bf2-af4f-7e3258e18d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.151105 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bd88d-a60f-4f8b-a86d-aa84cf12cdfd admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.152168 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7fa8-8126-4bf2-af4f-7e3258e18d94 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.162679 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 590/1174] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:38:32.162890 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 585/1175] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:38:32.166508 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bd88d-a60f-4f8b-a86d-aa84cf12cdfd admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.166668 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7fa8-8126-4bf2-af4f-7e3258e18d94 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.181226 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7fa8-8126-4bf2-af4f-7e3258e18d94 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.181468 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bd88d-a60f-4f8b-a86d-aa84cf12cdfd admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.181739 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59db5-df43-442a-b976-c0e629191ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.181860 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977f48-4206-4439-b733-07009c8453b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.182363 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59db5-df43-442a-b976-c0e629191ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.182592 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977f48-4206-4439-b733-07009c8453b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.182691 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59db5-df43-442a-b976-c0e629191ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.182986 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977f48-4206-4439-b733-07009c8453b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.183104 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59db5-df43-442a-b976-c0e629191ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.183190 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977f48-4206-4439-b733-07009c8453b6 admin admin] PATH_INFO: `/v3/projects/7a2c418848e749078c1165dd753daccc/users/e1f8c7932b5b46919af19db7b7e6425c/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.183575 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59db5-df43-442a-b976-c0e629191ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.185175 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59db5-df43-442a-b976-c0e629191ff1 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.195680 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 591/1176] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:38:32.199024 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba977f48-4206-4439-b733-07009c8453b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2c418848e749078c1165dd753daccc, user_id=e1f8c7932b5b46919af19db7b7e6425c, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.199730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING py.warnings [None req-ba977f48-4206-4439-b733-07009c8453b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:38:32.199730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: warnings.warn(msg) Aug 19 02:38:32.199730 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: Aug 19 02:38:32.200065 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59db5-df43-442a-b976-c0e629191ff1 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.201646 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba977f48-4206-4439-b733-07009c8453b6 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.210807 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59db5-df43-442a-b976-c0e629191ff1 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.216017 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccd22b-2dd6-42cc-a7a6-41798a4a795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.216703 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd22b-2dd6-42cc-a7a6-41798a4a795c admin admin] REQUEST_METHOD: `PUT` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.217618 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd22b-2dd6-42cc-a7a6-41798a4a795c admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.217920 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd22b-2dd6-42cc-a7a6-41798a4a795c admin admin] PATH_INFO: `/v3/projects/d3ed465718d74227b348c1d6705d491f/users/15d4d033befb471e84fcecbb00836e52/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.218895 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 586/1177] 10.222.0.69 () {60 vars in 1483 bytes} [Fri Aug 19 02:38:32 2022] PUT /identity/v3/projects/7a2c418848e749078c1165dd753daccc/users/e1f8c7932b5b46919af19db7b7e6425c/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:38:32.223866 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e870672-996d-4211-91da-3f14a0955167 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.224146 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e870672-996d-4211-91da-3f14a0955167 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.224419 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e870672-996d-4211-91da-3f14a0955167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.233358 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccd22b-2dd6-42cc-a7a6-41798a4a795c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ed465718d74227b348c1d6705d491f, user_id=15d4d033befb471e84fcecbb00836e52, role_id=f8b6e2d9bf5e427e9ccd9c371d8a8dc8)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.233570 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:32.236334 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccd22b-2dd6-42cc-a7a6-41798a4a795c admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.245756 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-4e870672-996d-4211-91da-3f14a0955167 None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:32.249293 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-4e870672-996d-4211-91da-3f14a0955167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:32.251626 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 592/1178] 10.222.0.69 () {60 vars in 1483 bytes} [Fri Aug 19 02:38:32 2022] PUT /identity/v3/projects/d3ed465718d74227b348c1d6705d491f/users/15d4d033befb471e84fcecbb00836e52/roles/f8b6e2d9bf5e427e9ccd9c371d8a8dc8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:38:32.256552 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dfb0f-174e-4f91-9249-07f0a2f28cdd None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.256849 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dfb0f-174e-4f91-9249-07f0a2f28cdd None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.257116 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dfb0f-174e-4f91-9249-07f0a2f28cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.275079 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-753dfb0f-174e-4f91-9249-07f0a2f28cdd None None] MFA Rules not processed for user `26749983e95c4ffb94568c58ecb1f0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:32.276270 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-753dfb0f-174e-4f91-9249-07f0a2f28cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:32.309414 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 587/1179] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:38:32.316408 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:32.320370 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e870672-996d-4211-91da-3f14a0955167 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.338526 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 593/1180] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:38:32.352625 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dfb0f-174e-4f91-9249-07f0a2f28cdd None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:32.376731 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e870672-996d-4211-91da-3f14a0955167 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.380544 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63500-6dda-41d0-a162-e146665e00e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.381337 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63500-6dda-41d0-a162-e146665e00e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.381675 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63500-6dda-41d0-a162-e146665e00e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.382009 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63500-6dda-41d0-a162-e146665e00e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.391844 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca63500-6dda-41d0-a162-e146665e00e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.393431 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca63500-6dda-41d0-a162-e146665e00e5 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.404240 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 588/1181] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:38:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:38:32.408834 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dfb0f-174e-4f91-9249-07f0a2f28cdd None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:32.413346 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc2e6-16af-41b1-b943-5010f5ec1456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:32.414280 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc2e6-16af-41b1-b943-5010f5ec1456 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:32.414619 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc2e6-16af-41b1-b943-5010f5ec1456 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:32.415163 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc2e6-16af-41b1-b943-5010f5ec1456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:32.425890 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc2e6-16af-41b1-b943-5010f5ec1456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:32.427446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc2e6-16af-41b1-b943-5010f5ec1456 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:32.437868 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 594/1182] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:38:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:38:37.920271 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a1e42-6a4a-40da-9846-8b55fd894965 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:37.921206 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a1e42-6a4a-40da-9846-8b55fd894965 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:37.921691 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a1e42-6a4a-40da-9846-8b55fd894965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:37.990896 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-026a1e42-6a4a-40da-9846-8b55fd894965 None None] MFA Rules not processed for user `15d4d033befb471e84fcecbb00836e52`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:37.992233 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-026a1e42-6a4a-40da-9846-8b55fd894965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:38.102451 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d623-bb02-4330-9c0b-5343ae049d7c None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.102943 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d623-bb02-4330-9c0b-5343ae049d7c None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.103138 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d623-bb02-4330-9c0b-5343ae049d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.123585 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 589/1183] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:37 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:38.125465 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a1e42-6a4a-40da-9846-8b55fd894965 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.151543 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a1e42-6a4a-40da-9846-8b55fd894965 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.156703 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec53aa6-6c17-497d-a6af-44924bb8a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.157825 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec53aa6-6c17-497d-a6af-44924bb8a8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.158110 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec53aa6-6c17-497d-a6af-44924bb8a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.158383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec53aa6-6c17-497d-a6af-44924bb8a8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.159090 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec53aa6-6c17-497d-a6af-44924bb8a8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.163190 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec53aa6-6c17-497d-a6af-44924bb8a8c7 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.164114 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-e556d623-bb02-4330-9c0b-5343ae049d7c None None] MFA Rules not processed for user `e1f8c7932b5b46919af19db7b7e6425c`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:38.165392 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-e556d623-bb02-4330-9c0b-5343ae049d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:38.229754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 590/1184] 10.222.0.69 () {60 vars in 1153 bytes} [Fri Aug 19 02:38:38 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:38:38.230988 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec53aa6-6c17-497d-a6af-44924bb8a8c7 admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.255516 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:38.292209 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 595/1185] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:38 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:38:38.293981 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556d623-bb02-4330-9c0b-5343ae049d7c None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.311815 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556d623-bb02-4330-9c0b-5343ae049d7c None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.327844 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec53aa6-6c17-497d-a6af-44924bb8a8c7 admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.334415 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6cf3-2cfa-47e9-9f34-71fcaee65543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.335597 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6cf3-2cfa-47e9-9f34-71fcaee65543 admin admin] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.335597 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6cf3-2cfa-47e9-9f34-71fcaee65543 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.335987 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6cf3-2cfa-47e9-9f34-71fcaee65543 admin admin] PATH_INFO: `/v3/users` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.336374 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c6cf3-2cfa-47e9-9f34-71fcaee65543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.338939 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c6cf3-2cfa-47e9-9f34-71fcaee65543 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.365411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 591/1186] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:38:38 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:38:38.369642 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6cf3-2cfa-47e9-9f34-71fcaee65543 admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.381776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6cf3-2cfa-47e9-9f34-71fcaee65543 admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.387034 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae094035-425b-4c37-83f7-3c5b4a3ccb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.387563 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae094035-425b-4c37-83f7-3c5b4a3ccb2c admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.387883 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae094035-425b-4c37-83f7-3c5b4a3ccb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.388159 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae094035-425b-4c37-83f7-3c5b4a3ccb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.388810 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae094035-425b-4c37-83f7-3c5b4a3ccb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.388959 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20135d76-fa58-40f2-9c3c-54c9bba6610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.389753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135d76-fa58-40f2-9c3c-54c9bba6610c admin admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.390123 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135d76-fa58-40f2-9c3c-54c9bba6610c admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.390457 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135d76-fa58-40f2-9c3c-54c9bba6610c admin admin] PATH_INFO: `/v3/projects` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.390796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae094035-425b-4c37-83f7-3c5b4a3ccb2c admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.391311 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135d76-fa58-40f2-9c3c-54c9bba6610c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.394561 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135d76-fa58-40f2-9c3c-54c9bba6610c admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.403168 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 592/1187] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:38:38.407348 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae094035-425b-4c37-83f7-3c5b4a3ccb2c admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.420874 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae094035-425b-4c37-83f7-3c5b4a3ccb2c admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.427183 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7f0fd-8f27-46c5-adc0-c98cf050b0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.427853 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7f0fd-8f27-46c5-adc0-c98cf050b0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.428133 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7f0fd-8f27-46c5-adc0-c98cf050b0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.428401 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7f0fd-8f27-46c5-adc0-c98cf050b0fc admin admin] PATH_INFO: `/v3/projects/b00e24757a2d487990011fa00cd84773/users/c165dfe8223c403ab87df353237a8159/roles/22d22ddee1804d668628115534a289ab` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.431520 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 596/1188] 10.222.0.69 () {60 vars in 1153 bytes} [Fri Aug 19 02:38:38 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:38:38.432267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20135d76-fa58-40f2-9c3c-54c9bba6610c admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.439666 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:38.450258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7f0fd-8f27-46c5-adc0-c98cf050b0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00e24757a2d487990011fa00cd84773, user_id=c165dfe8223c403ab87df353237a8159, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.453462 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7f0fd-8f27-46c5-adc0-c98cf050b0fc admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.473921 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 593/1189] 10.222.0.69 () {60 vars in 1483 bytes} [Fri Aug 19 02:38:38 2022] PUT /identity/v3/projects/b00e24757a2d487990011fa00cd84773/users/c165dfe8223c403ab87df353237a8159/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:38:38.478606 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7f0fd-8f27-46c5-adc0-c98cf050b0fc admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.510587 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20135d76-fa58-40f2-9c3c-54c9bba6610c admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.557290 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7f0fd-8f27-46c5-adc0-c98cf050b0fc admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.564321 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3408c-031e-4bd8-aade-70139281903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.564979 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3408c-031e-4bd8-aade-70139281903d admin admin] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.565258 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3408c-031e-4bd8-aade-70139281903d admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.565522 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3408c-031e-4bd8-aade-70139281903d admin admin] PATH_INFO: `/v3/roles` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.566173 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3408c-031e-4bd8-aade-70139281903d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.567812 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3408c-031e-4bd8-aade-70139281903d admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.579451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 594/1190] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:38:38.581675 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb92d5-811e-4482-8521-5ce93ed99cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.582694 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb92d5-811e-4482-8521-5ce93ed99cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.582958 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb92d5-811e-4482-8521-5ce93ed99cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.583247 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb92d5-811e-4482-8521-5ce93ed99cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.583896 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb92d5-811e-4482-8521-5ce93ed99cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.584013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3408c-031e-4bd8-aade-70139281903d admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.585886 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb92d5-811e-4482-8521-5ce93ed99cf3 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.594502 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3408c-031e-4bd8-aade-70139281903d admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.600524 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d440835-bbb2-4757-a9bd-4a86abda7343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.601403 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d440835-bbb2-4757-a9bd-4a86abda7343 admin admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.601688 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d440835-bbb2-4757-a9bd-4a86abda7343 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.602021 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d440835-bbb2-4757-a9bd-4a86abda7343 admin admin] PATH_INFO: `/v3/projects/b00e24757a2d487990011fa00cd84773/users/c165dfe8223c403ab87df353237a8159/roles/22d22ddee1804d668628115534a289ab` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.604326 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d440835-bbb2-4757-a9bd-4a86abda7343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00e24757a2d487990011fa00cd84773, user_id=c165dfe8223c403ab87df353237a8159, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.608009 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d440835-bbb2-4757-a9bd-4a86abda7343 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.612985 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 597/1191] 10.222.0.69 () {60 vars in 1144 bytes} [Fri Aug 19 02:38:38 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:38:38.617195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb92d5-811e-4482-8521-5ce93ed99cf3 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.620621 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 595/1192] 10.222.0.69 () {60 vars in 1483 bytes} [Fri Aug 19 02:38:38 2022] PUT /identity/v3/projects/b00e24757a2d487990011fa00cd84773/users/c165dfe8223c403ab87df353237a8159/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:38:38.629871 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb92d5-811e-4482-8521-5ce93ed99cf3 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.704644 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5efa-9ca7-4363-ba5f-9f2c70bec599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.705267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5efa-9ca7-4363-ba5f-9f2c70bec599 admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.705541 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5efa-9ca7-4363-ba5f-9f2c70bec599 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.705804 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5efa-9ca7-4363-ba5f-9f2c70bec599 admin admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.706464 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a5efa-9ca7-4363-ba5f-9f2c70bec599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.708491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a5efa-9ca7-4363-ba5f-9f2c70bec599 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.724523 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 598/1193] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:38:38.726160 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d440835-bbb2-4757-a9bd-4a86abda7343 admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.740480 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d440835-bbb2-4757-a9bd-4a86abda7343 admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.746531 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f7fce-834f-441d-ae7d-3f2d18fed1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.747325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f7fce-834f-441d-ae7d-3f2d18fed1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.747616 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f7fce-834f-441d-ae7d-3f2d18fed1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.747873 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f7fce-834f-441d-ae7d-3f2d18fed1bb admin admin] PATH_INFO: `/v3/projects/acaba1b1ff5745cab7a43909bb3f6ddb/users/75301dac043e46fa8eb2065e1bfa7b5b/roles/22d22ddee1804d668628115534a289ab` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.778409 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f7fce-834f-441d-ae7d-3f2d18fed1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=acaba1b1ff5745cab7a43909bb3f6ddb, user_id=75301dac043e46fa8eb2065e1bfa7b5b, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.782826 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f7fce-834f-441d-ae7d-3f2d18fed1bb admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.803985 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 596/1194] 10.222.0.69 () {60 vars in 1483 bytes} [Fri Aug 19 02:38:38 2022] PUT /identity/v3/projects/acaba1b1ff5745cab7a43909bb3f6ddb/users/75301dac043e46fa8eb2065e1bfa7b5b/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:38:38.807880 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5efa-9ca7-4363-ba5f-9f2c70bec599 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.820923 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5efa-9ca7-4363-ba5f-9f2c70bec599 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.874812 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:38.922070 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cc054-0931-439d-81cf-81c9015562fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.922793 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cc054-0931-439d-81cf-81c9015562fa admin admin] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.923163 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cc054-0931-439d-81cf-81c9015562fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.923509 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cc054-0931-439d-81cf-81c9015562fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.924272 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cc054-0931-439d-81cf-81c9015562fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.926172 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cc054-0931-439d-81cf-81c9015562fa admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:38.954764 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 599/1195] 10.222.0.69 () {58 vars in 1122 bytes} [Fri Aug 19 02:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:38:38.959545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f7fce-834f-441d-ae7d-3f2d18fed1bb admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:38.980704 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f7fce-834f-441d-ae7d-3f2d18fed1bb admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:38.988268 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:38.989177 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:38.989481 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:38.989735 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] PATH_INFO: `/v3/projects/acaba1b1ff5745cab7a43909bb3f6ddb/users/75301dac043e46fa8eb2065e1bfa7b5b/roles/22d22ddee1804d668628115534a289ab` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:38.991837 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=acaba1b1ff5745cab7a43909bb3f6ddb, user_id=75301dac043e46fa8eb2065e1bfa7b5b, role_id=22d22ddee1804d668628115534a289ab)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:38.994504 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:39.017404 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 597/1196] 10.222.0.69 () {60 vars in 1483 bytes} [Fri Aug 19 02:38:38 2022] PUT /identity/v3/projects/acaba1b1ff5745cab7a43909bb3f6ddb/users/75301dac043e46fa8eb2065e1bfa7b5b/roles/22d22ddee1804d668628115534a289ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:38:45.365224 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656ee8f-1cf5-4de4-86b7-07997caf9e2a None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:45.365713 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656ee8f-1cf5-4de4-86b7-07997caf9e2a None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:45.365802 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656ee8f-1cf5-4de4-86b7-07997caf9e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:45.400032 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-e656ee8f-1cf5-4de4-86b7-07997caf9e2a None None] MFA Rules not processed for user `c165dfe8223c403ab87df353237a8159`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:45.401258 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-e656ee8f-1cf5-4de4-86b7-07997caf9e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:45.498922 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 600/1197] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:45 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:45.508945 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:45.511078 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:45.559326 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:45.579093 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ddf75-7174-49bc-bf3d-2d512c13e3e3 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:45.580263 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ddf75-7174-49bc-bf3d-2d512c13e3e3 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:45.581099 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ddf75-7174-49bc-bf3d-2d512c13e3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:45.660104 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a02d7-f1ca-49aa-9ccb-e634642e73ef admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:45.661889 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-ea4ddf75-7174-49bc-bf3d-2d512c13e3e3 None None] MFA Rules not processed for user `75301dac043e46fa8eb2065e1bfa7b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:45.663312 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-ea4ddf75-7174-49bc-bf3d-2d512c13e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:45.671260 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd95883-3144-4ea0-940c-1b9b538e1c43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eb9db2887ee4e81aee4a4e2228f0add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:45.671678 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd95883-3144-4ea0-940c-1b9b538e1c43 service glance] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:45.671951 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd95883-3144-4ea0-940c-1b9b538e1c43 service glance] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:45.672298 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd95883-3144-4ea0-940c-1b9b538e1c43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:45.770795 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd95883-3144-4ea0-940c-1b9b538e1c43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:45.772325 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd95883-3144-4ea0-940c-1b9b538e1c43 service glance] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:45.784061 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 601/1198] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:45 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:45.807441 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 598/1199] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:38:45 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:38:45.811472 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ddf75-7174-49bc-bf3d-2d512c13e3e3 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:45.819737 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-ea4ddf75-7174-49bc-bf3d-2d512c13e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:45.833604 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ddf75-7174-49bc-bf3d-2d512c13e3e3 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:45.837904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e311cc-7cc2-49a9-a469-02735f72549c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eb9db2887ee4e81aee4a4e2228f0add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:45.838612 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e311cc-7cc2-49a9-a469-02735f72549c service glance] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:45.838940 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e311cc-7cc2-49a9-a469-02735f72549c service glance] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:45.840072 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e311cc-7cc2-49a9-a469-02735f72549c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:45.897368 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=100 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:45.957307 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e311cc-7cc2-49a9-a469-02735f72549c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:45.959196 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e311cc-7cc2-49a9-a469-02735f72549c service glance] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:45.986096 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 602/1200] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:38:45 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:38:54.098046 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d42e2-1d4e-4346-9018-1d5340c84595 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:54.098628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d42e2-1d4e-4346-9018-1d5340c84595 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:54.098628 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d42e2-1d4e-4346-9018-1d5340c84595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:54.120013 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-e18d42e2-1d4e-4346-9018-1d5340c84595 None None] MFA Rules not processed for user `15d4d033befb471e84fcecbb00836e52`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:54.121243 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-e18d42e2-1d4e-4346-9018-1d5340c84595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:54.131319 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 599/1201] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:38:54 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:54.425878 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265bec3-4f5b-43a7-a080-887bad00ce80 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:54.426504 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265bec3-4f5b-43a7-a080-887bad00ce80 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:54.426870 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265bec3-4f5b-43a7-a080-887bad00ce80 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:54.430306 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 603/1202] 10.222.0.69 () {54 vars in 962 bytes} [Fri Aug 19 02:38:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:38:54.436651 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294592-e616-440c-a9a1-8266a72fab66 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:54.436944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294592-e616-440c-a9a1-8266a72fab66 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:54.437216 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294592-e616-440c-a9a1-8266a72fab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:54.478490 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-a0294592-e616-440c-a9a1-8266a72fab66 None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:54.480178 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-a0294592-e616-440c-a9a1-8266a72fab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:54.559579 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 600/1203] 10.222.0.69 () {58 vars in 1059 bytes} [Fri Aug 19 02:38:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:54.566135 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5db0e-81c6-40fe-9a6b-f38925323244 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:54.566420 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5db0e-81c6-40fe-9a6b-f38925323244 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:54.566697 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5db0e-81c6-40fe-9a6b-f38925323244 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:54.568272 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 604/1204] 10.222.0.69 () {54 vars in 912 bytes} [Fri Aug 19 02:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:38:54.574438 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589c02-6508-449c-8340-6f732ee0a04d None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:54.574722 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589c02-6508-449c-8340-6f732ee0a04d None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:54.575059 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589c02-6508-449c-8340-6f732ee0a04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:54.600896 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-a4589c02-6508-449c-8340-6f732ee0a04d None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:54.602476 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-a4589c02-6508-449c-8340-6f732ee0a04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:54.612045 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 601/1205] 10.222.0.69 () {58 vars in 1009 bytes} [Fri Aug 19 02:38:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:38:54.623623 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5db0e-81c6-40fe-9a6b-f38925323244 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:54.634567 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5db0e-81c6-40fe-9a6b-f38925323244 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:54.638055 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5409c6-ce38-4be3-b4a2-ca43ad3ac8fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eb9db2887ee4e81aee4a4e2228f0add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:54.638649 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5409c6-ce38-4be3-b4a2-ca43ad3ac8fb service glance] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:54.638951 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5409c6-ce38-4be3-b4a2-ca43ad3ac8fb service glance] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:54.639260 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5409c6-ce38-4be3-b4a2-ca43ad3ac8fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:54.648830 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5409c6-ce38-4be3-b4a2-ca43ad3ac8fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:54.650302 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5409c6-ce38-4be3-b4a2-ca43ad3ac8fb service glance] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:54.661031 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 605/1206] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:38:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:38:55.127845 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce8519-8e16-4775-ae0e-6f6f054bc8ea None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.128429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce8519-8e16-4775-ae0e-6f6f054bc8ea None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.128429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce8519-8e16-4775-ae0e-6f6f054bc8ea None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.130023 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 602/1207] 10.222.0.69 () {54 vars in 912 bytes} [Fri Aug 19 02:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:38:55.135508 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780cf7c-6875-476a-b4cd-e0d87bd06251 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.136011 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780cf7c-6875-476a-b4cd-e0d87bd06251 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.136476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780cf7c-6875-476a-b4cd-e0d87bd06251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.171821 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-f780cf7c-6875-476a-b4cd-e0d87bd06251 None None] MFA Rules not processed for user `69dafc33dd0d4f85822f8d54af542ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:55.173062 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-f780cf7c-6875-476a-b4cd-e0d87bd06251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:55.224081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 606/1208] 10.222.0.69 () {58 vars in 1009 bytes} [Fri Aug 19 02:38:55 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:55.236579 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce8519-8e16-4775-ae0e-6f6f054bc8ea None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:55.247888 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce8519-8e16-4775-ae0e-6f6f054bc8ea None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:55.251463 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c94e3-3a2b-43ee-9e82-07e2fd82fd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:55.252051 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c94e3-3a2b-43ee-9e82-07e2fd82fd3d service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.252319 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c94e3-3a2b-43ee-9e82-07e2fd82fd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.252584 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c94e3-3a2b-43ee-9e82-07e2fd82fd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.259954 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c94e3-3a2b-43ee-9e82-07e2fd82fd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:55.261417 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c94e3-3a2b-43ee-9e82-07e2fd82fd3d service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:55.269647 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 603/1209] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:38:55 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:38:55.702564 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276289d-0a60-4629-ba5f-6a997ea9e0ad None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.703023 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276289d-0a60-4629-ba5f-6a997ea9e0ad None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.703153 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276289d-0a60-4629-ba5f-6a997ea9e0ad None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.704761 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 607/1210] 10.222.0.69 () {54 vars in 962 bytes} [Fri Aug 19 02:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:38:55.710932 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d2ba-2443-4103-984d-578b80a29ba8 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.711300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d2ba-2443-4103-984d-578b80a29ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.711300 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d2ba-2443-4103-984d-578b80a29ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.721767 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af3d81-d9f5-43fe-8cfc-11a696dc251a None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.722051 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af3d81-d9f5-43fe-8cfc-11a696dc251a None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.722319 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af3d81-d9f5-43fe-8cfc-11a696dc251a None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.723686 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 608/1211] 10.222.0.69 () {54 vars in 961 bytes} [Fri Aug 19 02:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:38:55.728895 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83927323-3b89-4c4e-bbcb-a381054a9253 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.729305 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83927323-3b89-4c4e-bbcb-a381054a9253 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.729674 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83927323-3b89-4c4e-bbcb-a381054a9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.737163 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-f894d2ba-2443-4103-984d-578b80a29ba8 None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:55.738369 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-f894d2ba-2443-4103-984d-578b80a29ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:55.747453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 604/1212] 10.222.0.69 () {58 vars in 1059 bytes} [Fri Aug 19 02:38:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:55.752261 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-83927323-3b89-4c4e-bbcb-a381054a9253 None None] MFA Rules not processed for user `530e9c679e6041f491eb9a93a74cc118`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:55.752928 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63d16-46f6-46c1-a457-bac25eaf4daa None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.753213 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63d16-46f6-46c1-a457-bac25eaf4daa None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.753466 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-83927323-3b89-4c4e-bbcb-a381054a9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:55.753671 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63d16-46f6-46c1-a457-bac25eaf4daa None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.754744 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 605/1213] 10.222.0.69 () {54 vars in 912 bytes} [Fri Aug 19 02:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:38:55.760071 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cde4b-7c7b-4cd1-97ef-b1403e3a24bc None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.760351 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cde4b-7c7b-4cd1-97ef-b1403e3a24bc None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.760626 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cde4b-7c7b-4cd1-97ef-b1403e3a24bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.789467 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-f94cde4b-7c7b-4cd1-97ef-b1403e3a24bc None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:38:55.790459 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-f94cde4b-7c7b-4cd1-97ef-b1403e3a24bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:55.799959 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 606/1214] 10.222.0.69 () {58 vars in 1009 bytes} [Fri Aug 19 02:38:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:38:55.811277 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cde4b-7c7b-4cd1-97ef-b1403e3a24bc None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:55.817413 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=100 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:38:55.822539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cde4b-7c7b-4cd1-97ef-b1403e3a24bc None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:55.826838 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368f2d6-3684-44fc-a644-9f9456ea65ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:55.827567 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f2d6-3684-44fc-a644-9f9456ea65ec service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.827910 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f2d6-3684-44fc-a644-9f9456ea65ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.828383 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f2d6-3684-44fc-a644-9f9456ea65ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.838526 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368f2d6-3684-44fc-a644-9f9456ea65ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:55.840106 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368f2d6-3684-44fc-a644-9f9456ea65ec service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:55.841479 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 609/1215] 10.222.0.69 () {58 vars in 1058 bytes} [Fri Aug 19 02:38:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:38:55.849001 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83927323-3b89-4c4e-bbcb-a381054a9253 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:38:55.852473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 607/1216] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:38:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:38:55.859983 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83927323-3b89-4c4e-bbcb-a381054a9253 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:38:55.866384 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530e9c679e6041f491eb9a93a74cc118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:38:55.867187 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:38:55.867556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:38:55.867910 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:38:55.869828 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:38:55.883041 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:38:55.884831 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:38:55.895240 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 610/1217] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:38:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:39:05.847992 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=4 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:39:05.890882 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=78 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:39:08.247807 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d18ca-719c-4b60-b74e-3dbcaab94889 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:08.248374 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d18ca-719c-4b60-b74e-3dbcaab94889 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:08.248374 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d18ca-719c-4b60-b74e-3dbcaab94889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:08.268410 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-038d18ca-719c-4b60-b74e-3dbcaab94889 None None] MFA Rules not processed for user `69dafc33dd0d4f85822f8d54af542ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:39:08.269627 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-038d18ca-719c-4b60-b74e-3dbcaab94889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:39:08.276411 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 608/1218] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 19 02:39:08 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:39:08.287953 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:39:08.298136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94107-1ecf-4ff7-9636-4e917dc6e0d2 service placement] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:39:08.301656 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9fc73-3b20-4964-81fa-dabd79eedd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:39:08.302398 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fc73-3b20-4964-81fa-dabd79eedd59 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:08.302688 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fc73-3b20-4964-81fa-dabd79eedd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:08.302961 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fc73-3b20-4964-81fa-dabd79eedd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:08.310077 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9fc73-3b20-4964-81fa-dabd79eedd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:39:08.311618 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9fc73-3b20-4964-81fa-dabd79eedd59 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:39:08.319708 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 611/1219] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:39:08 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:39:09.062182 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a5af-aab5-4cfb-9044-e16f24c489e4 None None] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:09.062470 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a5af-aab5-4cfb-9044-e16f24c489e4 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:09.062728 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a5af-aab5-4cfb-9044-e16f24c489e4 None None] PATH_INFO: `/` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:09.064193 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 609/1220] 10.222.0.69 () {54 vars in 921 bytes} [Fri Aug 19 02:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:39:09.095286 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410d7f-28a7-46ea-82f6-22d4b9280d3f None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:09.095607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410d7f-28a7-46ea-82f6-22d4b9280d3f None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:09.095840 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410d7f-28a7-46ea-82f6-22d4b9280d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:09.120190 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-2c410d7f-28a7-46ea-82f6-22d4b9280d3f None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:39:09.121848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-2c410d7f-28a7-46ea-82f6-22d4b9280d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:39:09.133466 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 612/1221] 10.222.0.69 () {58 vars in 1018 bytes} [Fri Aug 19 02:39:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:39:09.160922 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12a5af-aab5-4cfb-9044-e16f24c489e4 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:39:09.175296 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12a5af-aab5-4cfb-9044-e16f24c489e4 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:39:09.182224 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956834ea-51fc-4718-aa9b-363e42afc6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:39:09.183555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956834ea-51fc-4718-aa9b-363e42afc6eb service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:09.184033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956834ea-51fc-4718-aa9b-363e42afc6eb service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:09.184503 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956834ea-51fc-4718-aa9b-363e42afc6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:09.197828 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956834ea-51fc-4718-aa9b-363e42afc6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:39:09.200245 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956834ea-51fc-4718-aa9b-363e42afc6eb service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:39:09.214613 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 610/1222] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:39:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:39:16.290900 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6c6a-5854-4195-88e9-67306aefe8e6 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:16.291600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6c6a-5854-4195-88e9-67306aefe8e6 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:16.291600 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6c6a-5854-4195-88e9-67306aefe8e6 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:16.293165 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 613/1223] 10.222.0.69 () {54 vars in 921 bytes} [Fri Aug 19 02:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:39:16.303567 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897044-c97c-40dc-a1ca-d195461e1cee None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:16.304144 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897044-c97c-40dc-a1ca-d195461e1cee None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:16.304645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897044-c97c-40dc-a1ca-d195461e1cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:16.325474 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-4a897044-c97c-40dc-a1ca-d195461e1cee None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:39:16.326633 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-4a897044-c97c-40dc-a1ca-d195461e1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:39:16.336380 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 611/1224] 10.222.0.69 () {58 vars in 1018 bytes} [Fri Aug 19 02:39:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:39:16.352607 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da6c6a-5854-4195-88e9-67306aefe8e6 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:39:16.368081 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da6c6a-5854-4195-88e9-67306aefe8e6 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:39:16.373185 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa466-30c7-461f-86a6-52913a3ba7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:39:16.373848 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa466-30c7-461f-86a6-52913a3ba7e2 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:16.374195 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa466-30c7-461f-86a6-52913a3ba7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:16.374490 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa466-30c7-461f-86a6-52913a3ba7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:16.383734 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfa466-30c7-461f-86a6-52913a3ba7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:39:16.385347 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfa466-30c7-461f-86a6-52913a3ba7e2 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:39:16.395500 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 614/1225] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:39:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:39:26.320259 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=12 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:39:26.391821 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=15 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:39:29.886553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a897044-c97c-40dc-a1ca-d195461e1cee None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:39:29.896475 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a897044-c97c-40dc-a1ca-d195461e1cee None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:39:29.900179 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f0ec5-8093-4860-93b3-4aa8d532bcf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:39:29.900798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0ec5-8093-4860-93b3-4aa8d532bcf7 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:29.901070 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0ec5-8093-4860-93b3-4aa8d532bcf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:29.901336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0ec5-8093-4860-93b3-4aa8d532bcf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:29.912113 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0ec5-8093-4860-93b3-4aa8d532bcf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:39:29.913561 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0ec5-8093-4860-93b3-4aa8d532bcf7 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:39:29.923952 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 612/1226] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:39:29 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:39:31.947443 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf25f7-7d4a-4a4a-9f32-8324b8a726c7 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:31.948047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf25f7-7d4a-4a4a-9f32-8324b8a726c7 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:31.948047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf25f7-7d4a-4a4a-9f32-8324b8a726c7 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:31.949560 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 615/1227] 10.222.0.69 () {54 vars in 921 bytes} [Fri Aug 19 02:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:39:31.967404 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6717-8656-49d1-93c3-26a105d79ac7 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:31.967959 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6717-8656-49d1-93c3-26a105d79ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:31.969731 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6717-8656-49d1-93c3-26a105d79ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:31.999083 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-932a6717-8656-49d1-93c3-26a105d79ac7 None None] MFA Rules not processed for user `c27846f3ffc54cbcb0131c160d19c754`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:39:32.001509 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-932a6717-8656-49d1-93c3-26a105d79ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:39:32.013692 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 613/1228] 10.222.0.69 () {58 vars in 1018 bytes} [Fri Aug 19 02:39:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:39:32.029545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf25f7-7d4a-4a4a-9f32-8324b8a726c7 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:39:32.045776 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf25f7-7d4a-4a4a-9f32-8324b8a726c7 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:39:32.051822 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6246d-e4b2-4ff1-ad54-ed2fce42ae30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:39:32.052627 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6246d-e4b2-4ff1-ad54-ed2fce42ae30 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:32.053058 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6246d-e4b2-4ff1-ad54-ed2fce42ae30 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:32.053446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6246d-e4b2-4ff1-ad54-ed2fce42ae30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:32.063545 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6246d-e4b2-4ff1-ad54-ed2fce42ae30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:39:32.064962 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6246d-e4b2-4ff1-ad54-ed2fce42ae30 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:39:32.087476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 616/1229] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:39:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:39:41.991380 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=9 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:39:42.074721 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=6 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:39:44.585070 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee121-2406-4376-ad2e-6725178f7f74 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:39:44.585684 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee121-2406-4376-ad2e-6725178f7f74 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:39:44.585780 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee121-2406-4376-ad2e-6725178f7f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:39:44.605153 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-c2cee121-2406-4376-ad2e-6725178f7f74 None None] MFA Rules not processed for user `e1f8c7932b5b46919af19db7b7e6425c`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:39:44.606375 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-c2cee121-2406-4376-ad2e-6725178f7f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:39:44.613546 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 614/1230] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:39:44 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:39:54.600233 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:40:09.760543 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faab0e-737f-4a4b-b05c-fed913226395 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:40:09.761036 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faab0e-737f-4a4b-b05c-fed913226395 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:40:09.761119 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faab0e-737f-4a4b-b05c-fed913226395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:40:09.781317 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-46faab0e-737f-4a4b-b05c-fed913226395 None None] MFA Rules not processed for user `e1f8c7932b5b46919af19db7b7e6425c`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:40:09.782568 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-46faab0e-737f-4a4b-b05c-fed913226395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:40:09.790710 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 617/1231] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:40:09 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:40:10.075303 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf7fef-4813-4df7-857d-c16ac0e935c4 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:40:10.075774 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf7fef-4813-4df7-857d-c16ac0e935c4 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:40:10.075856 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf7fef-4813-4df7-857d-c16ac0e935c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:40:10.095506 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-c5bf7fef-4813-4df7-857d-c16ac0e935c4 None None] MFA Rules not processed for user `69dafc33dd0d4f85822f8d54af542ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:40:10.096697 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-c5bf7fef-4813-4df7-857d-c16ac0e935c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:40:10.104302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 615/1232] 10.222.0.69 () {58 vars in 1009 bytes} [Fri Aug 19 02:40:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:40:10.115905 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faab0e-737f-4a4b-b05c-fed913226395 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:40:10.126259 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faab0e-737f-4a4b-b05c-fed913226395 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:40:10.130483 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8189f-0b14-4dde-9a8a-fe4da438eb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:40:10.131155 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8189f-0b14-4dde-9a8a-fe4da438eb2a service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:40:10.131412 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8189f-0b14-4dde-9a8a-fe4da438eb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:40:10.131679 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8189f-0b14-4dde-9a8a-fe4da438eb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:40:10.139046 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8189f-0b14-4dde-9a8a-fe4da438eb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:40:10.140488 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8189f-0b14-4dde-9a8a-fe4da438eb2a service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:40:10.148483 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 618/1233] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:40:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:40:20.090619 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:40:20.145025 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=9 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:40:25.588936 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ead91d-ff16-454e-91fb-8d7852cee293 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:40:25.589471 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ead91d-ff16-454e-91fb-8d7852cee293 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:40:25.589471 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ead91d-ff16-454e-91fb-8d7852cee293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:40:25.609283 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-a4ead91d-ff16-454e-91fb-8d7852cee293 None None] MFA Rules not processed for user `e1f8c7932b5b46919af19db7b7e6425c`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:40:25.610500 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-a4ead91d-ff16-454e-91fb-8d7852cee293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:40:25.618555 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 616/1234] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:40:25 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:40:35.604207 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:41:26.982664 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d70f48-d1e6-43e8-afdc-83117d062350 None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:41:26.983236 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d70f48-d1e6-43e8-afdc-83117d062350 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:41:26.983236 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d70f48-d1e6-43e8-afdc-83117d062350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:41:27.003875 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-41d70f48-d1e6-43e8-afdc-83117d062350 None None] MFA Rules not processed for user `e1f8c7932b5b46919af19db7b7e6425c`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:41:27.005083 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-41d70f48-d1e6-43e8-afdc-83117d062350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:41:27.012729 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 619/1235] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:41:26 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:41:36.998738 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=3 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:41:40.006371 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ead91d-ff16-454e-91fb-8d7852cee293 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:41:40.037064 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ead91d-ff16-454e-91fb-8d7852cee293 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:41:40.041776 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f582-44ac-4751-bc24-f80bf718e0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:41:40.042379 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f582-44ac-4751-bc24-f80bf718e0eb service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:41:40.042652 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f582-44ac-4751-bc24-f80bf718e0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:41:40.042914 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f582-44ac-4751-bc24-f80bf718e0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:41:40.053429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292f582-44ac-4751-bc24-f80bf718e0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:41:40.054881 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292f582-44ac-4751-bc24-f80bf718e0eb service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:41:40.065162 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 617/1236] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:41:40 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:41:50.060127 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=10 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:42:51.283690 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d70f48-d1e6-43e8-afdc-83117d062350 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:42:51.306779 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d70f48-d1e6-43e8-afdc-83117d062350 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:42:51.312294 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd233b-9d70-4803-a88e-d125cf6abd77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530e9c679e6041f491eb9a93a74cc118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:42:51.312893 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd233b-9d70-4803-a88e-d125cf6abd77 service placement] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:42:51.313171 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd233b-9d70-4803-a88e-d125cf6abd77 service placement] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:42:51.313440 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd233b-9d70-4803-a88e-d125cf6abd77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:42:51.321942 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd233b-9d70-4803-a88e-d125cf6abd77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:42:51.323588 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd233b-9d70-4803-a88e-d125cf6abd77 service placement] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:42:51.333703 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 620/1237] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:42:51 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:43:01.329782 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=10 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:43:46.697725 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f582-44ac-4751-bc24-f80bf718e0eb service neutron] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:43:46.725899 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f582-44ac-4751-bc24-f80bf718e0eb service neutron] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:43:46.733198 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a4d4-9c68-4e3e-a73e-8a12dc73ce7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:43:46.734149 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a4d4-9c68-4e3e-a73e-8a12dc73ce7f service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:43:46.734565 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a4d4-9c68-4e3e-a73e-8a12dc73ce7f service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:43:46.734967 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a4d4-9c68-4e3e-a73e-8a12dc73ce7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:43:46.746834 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a4d4-9c68-4e3e-a73e-8a12dc73ce7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:43:46.749364 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a4d4-9c68-4e3e-a73e-8a12dc73ce7f service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:43:46.761151 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 618/1238] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:43:46 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:43:51.876435 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b626a2-ab56-4a92-9dee-3c3b3ee752ca None None] REQUEST_METHOD: `POST` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:43:51.876952 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b626a2-ab56-4a92-9dee-3c3b3ee752ca None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:43:51.876952 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b626a2-ab56-4a92-9dee-3c3b3ee752ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:43:51.896908 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.auth.core [None req-c8b626a2-ab56-4a92-9dee-3c3b3ee752ca None None] MFA Rules not processed for user `e1f8c7932b5b46919af19db7b7e6425c`. Rule list: `[]` (Enabled: `True`). {{(pid=88490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:43:51.898200 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-c8b626a2-ab56-4a92-9dee-3c3b3ee752ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:43:51.906295 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 621/1239] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:43:51 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:43:56.185039 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a4d4-9c68-4e3e-a73e-8a12dc73ce7f service nova] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:43:56.197680 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a4d4-9c68-4e3e-a73e-8a12dc73ce7f service nova] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:43:56.201644 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8194b1f-f41d-4dd5-a01e-8775f7bdf96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:43:56.202255 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8194b1f-f41d-4dd5-a01e-8775f7bdf96a service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:43:56.202528 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8194b1f-f41d-4dd5-a01e-8775f7bdf96a service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:43:56.202797 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8194b1f-f41d-4dd5-a01e-8775f7bdf96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:43:56.213324 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8194b1f-f41d-4dd5-a01e-8775f7bdf96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:43:56.214757 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8194b1f-f41d-4dd5-a01e-8775f7bdf96a service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:43:56.225057 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 619/1240] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:43:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:43:57.414706 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b626a2-ab56-4a92-9dee-3c3b3ee752ca None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:43:57.424970 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b626a2-ab56-4a92-9dee-3c3b3ee752ca None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:43:57.428740 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d07ff-ade8-4c7c-ba40-a4fff4d45713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:43:57.429372 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d07ff-ade8-4c7c-ba40-a4fff4d45713 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:43:57.429642 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d07ff-ade8-4c7c-ba40-a4fff4d45713 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:43:57.429892 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d07ff-ade8-4c7c-ba40-a4fff4d45713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:43:57.439446 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d07ff-ade8-4c7c-ba40-a4fff4d45713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:43:57.440891 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d07ff-ade8-4c7c-ba40-a4fff4d45713 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:43:57.451121 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 622/1241] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:43:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:44:06.055261 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8194b1f-f41d-4dd5-a01e-8775f7bdf96a service neutron] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:44:06.066658 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8194b1f-f41d-4dd5-a01e-8775f7bdf96a service neutron] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:44:06.073077 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdbb4b-4ae4-462c-a132-5178d33e54bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:44:06.073955 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbb4b-4ae4-462c-a132-5178d33e54bd service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:44:06.074429 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbb4b-4ae4-462c-a132-5178d33e54bd service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:44:06.074726 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdbb4b-4ae4-462c-a132-5178d33e54bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:44:06.083618 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdbb4b-4ae4-462c-a132-5178d33e54bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:44:06.085243 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdbb4b-4ae4-462c-a132-5178d33e54bd service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:44:06.094153 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 620/1242] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:44:06 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:44:07.446555 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=9 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:44:08.833586 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d07ff-ade8-4c7c-ba40-a4fff4d45713 service neutron] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:44:08.843136 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d07ff-ade8-4c7c-ba40-a4fff4d45713 service neutron] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:44:08.847749 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1653f-380a-4b6f-b8ac-d7aede26c52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:44:08.848373 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1653f-380a-4b6f-b8ac-d7aede26c52e service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:44:08.848649 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1653f-380a-4b6f-b8ac-d7aede26c52e service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:44:08.848871 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1653f-380a-4b6f-b8ac-d7aede26c52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:44:08.857919 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1653f-380a-4b6f-b8ac-d7aede26c52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:44:08.859344 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1653f-380a-4b6f-b8ac-d7aede26c52e service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:44:08.869544 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 623/1243] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:44:08 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:44:16.090230 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=22 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:44:18.864245 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=6 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:44:21.625699 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea7fe1-5c77-4ad0-bf27-11080c8cc029 None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:44:21.626227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea7fe1-5c77-4ad0-bf27-11080c8cc029 None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:44:21.626227 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea7fe1-5c77-4ad0-bf27-11080c8cc029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:44:21.645660 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-e2ea7fe1-5c77-4ad0-bf27-11080c8cc029 None None] MFA Rules not processed for user `15d4d033befb471e84fcecbb00836e52`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:44:21.646898 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-e2ea7fe1-5c77-4ad0-bf27-11080c8cc029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:44:21.655853 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 621/1244] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:44:21 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:44:22.521267 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1653f-380a-4b6f-b8ac-d7aede26c52e service neutron] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:44:22.535210 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1653f-380a-4b6f-b8ac-d7aede26c52e service neutron] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:44:22.541176 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1757e-96d5-42e4-b777-1961144bc9a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530e9c679e6041f491eb9a93a74cc118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:44:22.541844 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1757e-96d5-42e4-b777-1961144bc9a7 service placement] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:44:22.542224 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1757e-96d5-42e4-b777-1961144bc9a7 service placement] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:44:22.542558 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1757e-96d5-42e4-b777-1961144bc9a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:44:22.552673 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1757e-96d5-42e4-b777-1961144bc9a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:44:22.554691 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1757e-96d5-42e4-b777-1961144bc9a7 service placement] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:44:22.566770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 624/1245] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:44:22 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:44:31.640870 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:44:32.561422 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=6 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:44:34.852035 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea7fe1-5c77-4ad0-bf27-11080c8cc029 None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:44:34.871131 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea7fe1-5c77-4ad0-bf27-11080c8cc029 None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:44:34.879519 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a1324-ce5e-4efe-ab25-d34e09549c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:44:34.880336 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a1324-ce5e-4efe-ab25-d34e09549c70 service nova] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:44:34.880642 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a1324-ce5e-4efe-ab25-d34e09549c70 service nova] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:44:34.880942 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a1324-ce5e-4efe-ab25-d34e09549c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:44:34.901645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a1324-ce5e-4efe-ab25-d34e09549c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:44:34.901645 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a1324-ce5e-4efe-ab25-d34e09549c70 service nova] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:44:34.905027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 622/1246] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:44:34 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:44:40.046613 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1757e-96d5-42e4-b777-1961144bc9a7 service placement] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:44:40.061104 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1757e-96d5-42e4-b777-1961144bc9a7 service placement] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:44:40.066372 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e65ac5-9b7b-4f45-a2b4-3a2599104c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:44:40.066966 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65ac5-9b7b-4f45-a2b4-3a2599104c56 service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:44:40.067270 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65ac5-9b7b-4f45-a2b4-3a2599104c56 service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:44:40.067533 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65ac5-9b7b-4f45-a2b4-3a2599104c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:44:40.076465 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e65ac5-9b7b-4f45-a2b4-3a2599104c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:44:40.078106 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e65ac5-9b7b-4f45-a2b4-3a2599104c56 service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:44:40.088594 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 625/1247] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:44:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:44:44.900055 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=6 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:44:47.839662 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a1324-ce5e-4efe-ab25-d34e09549c70 service nova] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:44:47.849974 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a1324-ce5e-4efe-ab25-d34e09549c70 service nova] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:44:47.854033 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c572db-c130-4d49-b1f3-9d88db4c9a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:44:47.854460 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c572db-c130-4d49-b1f3-9d88db4c9a19 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:44:47.854737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c572db-c130-4d49-b1f3-9d88db4c9a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:44:47.855027 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c572db-c130-4d49-b1f3-9d88db4c9a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:44:47.864318 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c572db-c130-4d49-b1f3-9d88db4c9a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:44:47.865796 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c572db-c130-4d49-b1f3-9d88db4c9a19 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:44:47.875307 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 623/1248] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:44:47 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:44:50.084655 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=6 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:44:50.835333 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e65ac5-9b7b-4f45-a2b4-3a2599104c56 service nova] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:44:50.846494 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e65ac5-9b7b-4f45-a2b4-3a2599104c56 service nova] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:44:50.854620 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b361b-ab21-4550-84d0-29fa2eed7e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27846f3ffc54cbcb0131c160d19c754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:44:50.855491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b361b-ab21-4550-84d0-29fa2eed7e1b service nova] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:44:50.855839 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b361b-ab21-4550-84d0-29fa2eed7e1b service nova] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:44:50.856177 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b361b-ab21-4550-84d0-29fa2eed7e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:44:50.866315 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b361b-ab21-4550-84d0-29fa2eed7e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:44:50.868148 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b361b-ab21-4550-84d0-29fa2eed7e1b service nova] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:44:50.882753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 626/1249] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:44:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:44:57.871316 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=6 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:45:00.876764 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=6 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:45:59.170614 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af155fd-0e15-4a10-bb7c-00b5fc28172b None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:45:59.171257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af155fd-0e15-4a10-bb7c-00b5fc28172b None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:45:59.171257 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af155fd-0e15-4a10-bb7c-00b5fc28172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:45:59.191226 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-7af155fd-0e15-4a10-bb7c-00b5fc28172b None None] MFA Rules not processed for user `e1f8c7932b5b46919af19db7b7e6425c`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:45:59.192453 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-7af155fd-0e15-4a10-bb7c-00b5fc28172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:45:59.199788 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 624/1250] 10.222.0.69 () {58 vars in 958 bytes} [Fri Aug 19 02:45:59 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:45:59.531112 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b361b-ab21-4550-84d0-29fa2eed7e1b service nova] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:45:59.541261 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b361b-ab21-4550-84d0-29fa2eed7e1b service nova] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:45:59.545423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c027a-8ec4-4fba-85f5-fb3eab345017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:45:59.546017 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c027a-8ec4-4fba-85f5-fb3eab345017 service neutron] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:45:59.546291 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c027a-8ec4-4fba-85f5-fb3eab345017 service neutron] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:45:59.546557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c027a-8ec4-4fba-85f5-fb3eab345017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:45:59.553602 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c027a-8ec4-4fba-85f5-fb3eab345017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:45:59.555026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c027a-8ec4-4fba-85f5-fb3eab345017 service neutron] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:45:59.563905 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 627/1251] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:45:59 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:46:09.186668 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=3 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:46:09.559522 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=6 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:47:15.186756 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af155fd-0e15-4a10-bb7c-00b5fc28172b None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:47:15.188451 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-7af155fd-0e15-4a10-bb7c-00b5fc28172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:47:15.236598 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af155fd-0e15-4a10-bb7c-00b5fc28172b None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:47:15.240445 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fca74-32f0-4c3a-a0d3-2353bbceb342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:47:15.241063 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fca74-32f0-4c3a-a0d3-2353bbceb342 service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:15.241339 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fca74-32f0-4c3a-a0d3-2353bbceb342 service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:15.241649 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fca74-32f0-4c3a-a0d3-2353bbceb342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:15.354747 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fca74-32f0-4c3a-a0d3-2353bbceb342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:47:15.356255 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fca74-32f0-4c3a-a0d3-2353bbceb342 service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:47:15.380931 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 625/1252] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:47:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:47:19.020757 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d7c8-7098-4beb-ac8f-9e487b202204 None None] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:19.021301 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d7c8-7098-4beb-ac8f-9e487b202204 None None] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:19.021301 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d7c8-7098-4beb-ac8f-9e487b202204 None None] PATH_INFO: `/` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:19.022779 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 628/1253] 10.222.0.69 () {54 vars in 921 bytes} [Fri Aug 19 02:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:47:19.055482 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52a7b-ea8e-4d96-9df6-b932ca23f23c None None] REQUEST_METHOD: `POST` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:19.056024 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52a7b-ea8e-4d96-9df6-b932ca23f23c None None] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:19.056024 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52a7b-ea8e-4d96-9df6-b932ca23f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:19.141599 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.auth.core [None req-f1c52a7b-ea8e-4d96-9df6-b932ca23f23c None None] MFA Rules not processed for user `530e9c679e6041f491eb9a93a74cc118`. Rule list: `[]` (Enabled: `True`). {{(pid=88489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:47:19.143037 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-f1c52a7b-ea8e-4d96-9df6-b932ca23f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:47:19.152377 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 626/1254] 10.222.0.69 () {58 vars in 1018 bytes} [Fri Aug 19 02:47:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:47:19.164616 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d7c8-7098-4beb-ac8f-9e487b202204 None None] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:47:19.178796 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d7c8-7098-4beb-ac8f-9e487b202204 None None] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:47:19.183941 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0462e-a4a0-4443-910b-e4962d4aa9fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530e9c679e6041f491eb9a93a74cc118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:47:19.184753 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0462e-a4a0-4443-910b-e4962d4aa9fd service placement] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:19.185026 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0462e-a4a0-4443-910b-e4962d4aa9fd service placement] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:19.185293 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0462e-a4a0-4443-910b-e4962d4aa9fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:19.194217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0462e-a4a0-4443-910b-e4962d4aa9fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:47:19.195775 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0462e-a4a0-4443-910b-e4962d4aa9fd service placement] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:47:19.205876 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 629/1255] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:47:19 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:47:22.261420 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c52a7b-ea8e-4d96-9df6-b932ca23f23c None None] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:47:22.276359 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c52a7b-ea8e-4d96-9df6-b932ca23f23c None None] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:47:22.282488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:47:22.283535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:22.283816 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:22.284106 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] PATH_INFO: `/v3/users/15d4d033befb471e84fcecbb00836e52` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:22.285406 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d4d033befb471e84fcecbb00836e52)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:47:22.286708 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: WARNING py.warnings [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:47:22.286708 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: warnings.warn(msg) Aug 19 02:47:22.286708 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: Aug 19 02:47:22.288327 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:47:22.347019 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:47:22.360760 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d4d033befb471e84fcecbb00836e52'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.382917 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d4d033befb471e84fcecbb00836e52'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.383634 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d4d033befb471e84fcecbb00836e52'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.384350 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d4d033befb471e84fcecbb00836e52'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.396583 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d4d033befb471e84fcecbb00836e52'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.410940 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 627/1256] 10.222.0.69 () {58 vars in 1224 bytes} [Fri Aug 19 02:47:22 2022] DELETE /identity/v3/users/15d4d033befb471e84fcecbb00836e52 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:47:22.604839 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0462e-a4a0-4443-910b-e4962d4aa9fd service placement] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:47:22.617253 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0462e-a4a0-4443-910b-e4962d4aa9fd service placement] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:47:22.677991 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:47:22.678629 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:22.678904 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:22.679218 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] PATH_INFO: `/v3/projects/d3ed465718d74227b348c1d6705d491f` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:22.680330 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ed465718d74227b348c1d6705d491f)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:47:22.681354 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: WARNING py.warnings [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:47:22.681354 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: warnings.warn(msg) Aug 19 02:47:22.681354 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: Aug 19 02:47:22.682548 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:47:22.743476 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ed465718d74227b348c1d6705d491f', 'request_id': 'req-a0205a83-d915-4343-ae9e-3edf7605c723'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.759692 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ed465718d74227b348c1d6705d491f', 'request_id': 'req-a0205a83-d915-4343-ae9e-3edf7605c723'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.773751 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ed465718d74227b348c1d6705d491f', 'request_id': 'req-a0205a83-d915-4343-ae9e-3edf7605c723'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.801770 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] The token cache is being invalidate because project d3ed465718d74227b348c1d6705d491f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:47:22.802101 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.802752 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.804304 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 630/1257] 10.222.0.69 () {58 vars in 1233 bytes} [Fri Aug 19 02:47:22 2022] DELETE /identity/v3/projects/d3ed465718d74227b348c1d6705d491f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:47:22.808488 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:47:22.809944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:47:22.824657 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c58c1b-1911-472f-b6d4-db2b0addd449 admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:47:22.884737 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:47:22.885199 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:22.885473 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:22.885741 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] PATH_INFO: `/v3/users/c165dfe8223c403ab87df353237a8159` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:22.886968 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c165dfe8223c403ab87df353237a8159)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:47:22.888930 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:47:22.940869 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c165dfe8223c403ab87df353237a8159'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.953514 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c165dfe8223c403ab87df353237a8159'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.954344 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c165dfe8223c403ab87df353237a8159'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.955076 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c165dfe8223c403ab87df353237a8159'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.961875 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c165dfe8223c403ab87df353237a8159'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:22.974575 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 628/1258] 10.222.0.69 () {58 vars in 1224 bytes} [Fri Aug 19 02:47:22 2022] DELETE /identity/v3/users/c165dfe8223c403ab87df353237a8159 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:47:23.172961 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:47:23.174839 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:47:23.190557 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205a83-d915-4343-ae9e-3edf7605c723 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:47:23.260809 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:47:23.261445 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:23.261717 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:23.261982 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] PATH_INFO: `/v3/projects/b00e24757a2d487990011fa00cd84773` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:23.263146 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00e24757a2d487990011fa00cd84773)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:47:23.265183 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:47:23.273416 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:47:23.312091 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00e24757a2d487990011fa00cd84773', 'request_id': 'req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:23.318835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00e24757a2d487990011fa00cd84773', 'request_id': 'req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:23.330837 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00e24757a2d487990011fa00cd84773', 'request_id': 'req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:23.343390 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] The token cache is being invalidate because project b00e24757a2d487990011fa00cd84773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:47:23.343683 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:23.344314 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:47:23.345835 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 631/1259] 10.222.0.69 () {58 vars in 1233 bytes} [Fri Aug 19 02:47:23 2022] DELETE /identity/v3/projects/b00e24757a2d487990011fa00cd84773 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:47:32.971564 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=69,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:47:33.340442 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:47:55.228168 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:47:55.230241 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:47:55.308987 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d5f03-be76-4238-8e16-ad91ac9759d7 admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:47:55.376630 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530e9c679e6041f491eb9a93a74cc118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:47:55.377275 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:47:55.377553 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:47:55.377827 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:47:55.379948 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:47:55.391944 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:47:55.393532 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:47:55.403754 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 629/1260] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:47:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:48:05.399529 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=58 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:48:46.574056 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:48:46.577211 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:48:46.669047 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1f6b5-fe0e-4e67-a28e-89acfe0eca2f admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:48:46.673302 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c679a1bdee541f2830dce7ee89e60f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:48:46.673922 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:48:46.674205 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:48:46.674496 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:48:46.676392 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:48:46.760752 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:48:46.762218 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:48:46.780456 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 632/1261] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:48:46 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:48:54.269115 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:48:54.270574 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:48:54.328301 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534eaef-966d-446c-b5bc-a70f018ea73b service placement] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:48:54.332377 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dafc33dd0d4f85822f8d54af542ee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:48:54.332993 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] REQUEST_METHOD: `GET` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:48:54.333270 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:48:54.333545 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:48:54.335514 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:48:54.398850 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:48:54.400345 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:48:54.411087 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 630/1262] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:48:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:48:56.777952 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=70 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:49:00.520365 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:49:00.521929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:49:00.537065 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0daa4-5748-4da1-8f69-31a129dfa5c9 service cinder] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:49:00.542361 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:49:00.543122 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:49:00.543590 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:49:00.543877 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] PATH_INFO: `/v3/users/e1f8c7932b5b46919af19db7b7e6425c` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:49:00.545071 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f8c7932b5b46919af19db7b7e6425c)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:49:00.547159 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:49:00.603491 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f8c7932b5b46919af19db7b7e6425c'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.615226 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f8c7932b5b46919af19db7b7e6425c'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.615929 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f8c7932b5b46919af19db7b7e6425c'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.616619 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f8c7932b5b46919af19db7b7e6425c'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.623423 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f8c7932b5b46919af19db7b7e6425c'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.638587 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 633/1263] 10.222.0.69 () {58 vars in 1224 bytes} [Fri Aug 19 02:49:00 2022] DELETE /identity/v3/users/e1f8c7932b5b46919af19db7b7e6425c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:49:00.829685 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:49:00.839535 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd185eb-bd08-43e5-bb3c-d05ebd57481b service neutron] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:49:00.895998 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:49:00.896629 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:49:00.896900 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:49:00.897167 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] PATH_INFO: `/v3/projects/7a2c418848e749078c1165dd753daccc` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:49:00.898302 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2c418848e749078c1165dd753daccc)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:49:00.900234 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:49:00.948092 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2c418848e749078c1165dd753daccc', 'request_id': 'req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.950434 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:49:00.955541 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2c418848e749078c1165dd753daccc', 'request_id': 'req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.963962 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2c418848e749078c1165dd753daccc', 'request_id': 'req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.974397 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] The token cache is being invalidate because project 7a2c418848e749078c1165dd753daccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:49:00.974686 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.975317 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:00.977057 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 631/1264] 10.222.0.69 () {58 vars in 1233 bytes} [Fri Aug 19 02:49:00 2022] DELETE /identity/v3/projects/7a2c418848e749078c1165dd753daccc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:49:00.981322 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:49:00.982722 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:49:00.996324 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023434b-9138-47c7-a154-f4d3085b6c8e admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:49:01.064528 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:49:01.065072 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:49:01.065351 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:49:01.065646 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] PATH_INFO: `/v3/users/75301dac043e46fa8eb2065e1bfa7b5b` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:49:01.082530 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75301dac043e46fa8eb2065e1bfa7b5b)` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:49:01.084556 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:49:01.137014 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75301dac043e46fa8eb2065e1bfa7b5b'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.147551 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:49:01.148715 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75301dac043e46fa8eb2065e1bfa7b5b'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.149370 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75301dac043e46fa8eb2065e1bfa7b5b'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.150002 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75301dac043e46fa8eb2065e1bfa7b5b'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.158788 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.notifications [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75301dac043e46fa8eb2065e1bfa7b5b'} {{(pid=88490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.171971 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 634/1265] 10.222.0.69 () {58 vars in 1224 bytes} [Fri Aug 19 02:49:00 2022] DELETE /identity/v3/users/75301dac043e46fa8eb2065e1bfa7b5b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:49:01.350437 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] Authenticating user token {{(pid=88489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:49:01.352016 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.fernet_utils [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:49:01.364886 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc1d0b-3c37-4c37-b8b2-cb36668465ac admin admin] Validating token access rules against request {{(pid=88489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:49:01.426968 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26749983e95c4ffb94568c58ecb1f0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffd15eac07ca4582ba473f869ddd41c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:49:01.427623 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:49:01.427903 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:49:01.428169 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] PATH_INFO: `/v3/projects/acaba1b1ff5745cab7a43909bb3f6ddb` {{(pid=88489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:49:01.440002 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=acaba1b1ff5745cab7a43909bb3f6ddb)` {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:49:01.441981 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] RBAC: Authorization granted {{(pid=88489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:49:01.496478 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acaba1b1ff5745cab7a43909bb3f6ddb', 'request_id': 'req-23fcb256-07e5-44fe-be7e-927fc0d24f4a'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.503496 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acaba1b1ff5745cab7a43909bb3f6ddb', 'request_id': 'req-23fcb256-07e5-44fe-be7e-927fc0d24f4a'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.512456 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acaba1b1ff5745cab7a43909bb3f6ddb', 'request_id': 'req-23fcb256-07e5-44fe-be7e-927fc0d24f4a'} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.522513 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] The token cache is being invalidate because project acaba1b1ff5745cab7a43909bb3f6ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:49:01.522798 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.523539 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG keystone.notifications [None req-23fcb256-07e5-44fe-be7e-927fc0d24f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:49:01.525058 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: [pid: 88489|app: 0|req: 632/1266] 10.222.0.69 () {58 vars in 1233 bytes} [Fri Aug 19 02:49:01 2022] DELETE /identity/v3/projects/acaba1b1ff5745cab7a43909bb3f6ddb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:49:11.168780 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:49:11.519909 dv-osbrick-853457-2-ceph devstack@keystone.service[88489]: DEBUG dbcounter [-] [88489] Writing DB stats keystone:SELECT=60,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:52:59.205254 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] Authenticating user token {{(pid=88490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:52:59.206980 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:52:59.292333 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e71c8-635b-4e0f-9e6a-b60975aa71c0 admin admin] Validating token access rules against request {{(pid=88490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:52:59.361174 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda37b1-4b47-4020-852b-096c38d124fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530e9c679e6041f491eb9a93a74cc118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba3fce45fd90438a989865dcdda638f9', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:52:59.361784 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda37b1-4b47-4020-852b-096c38d124fd service placement] REQUEST_METHOD: `GET` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:52:59.362069 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda37b1-4b47-4020-852b-096c38d124fd service placement] SCRIPT_NAME: `/identity` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:52:59.362329 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda37b1-4b47-4020-852b-096c38d124fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:52:59.364352 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.fernet_utils [None req-ecda37b1-4b47-4020-852b-096c38d124fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:52:59.375599 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda37b1-4b47-4020-852b-096c38d124fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:52:59.377217 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda37b1-4b47-4020-852b-096c38d124fd service placement] RBAC: Authorization granted {{(pid=88490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:52:59.386843 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: [pid: 88490|app: 0|req: 635/1267] 10.222.0.69 () {60 vars in 1365 bytes} [Fri Aug 19 02:52:59 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:53:09.383141 dv-osbrick-853457-2-ceph devstack@keystone.service[88490]: DEBUG dbcounter [-] [88490] Writing DB stats keystone:SELECT=62 {{(pid=88490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}